-- Logs begin at Thu 2021-05-13 15:31:27 UTC, end at Thu 2021-05-13 16:44:11 UTC. -- May 13 16:14:17.274152 dv-cinder-689486-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 16:14:17.281674 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 13 16:14:17 2021] *** May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: nodename: dv-cinder-689486-12-iscsi May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: machine: x86_64 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: clock source: unix May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: pcre jit disabled May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: detected number of CPU cores: 4 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: current working directory: / May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: detected binary path: /usr/bin/uwsgi-core May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: your processes number limit is 47680 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: your memory page size is 4096 bytes May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: detected max file descriptor number: 2048 May 13 16:14:17.283677 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: lock engine: pthread robust mutexes May 13 16:14:17.284608 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: thunder lock: enabled May 13 16:14:17.284608 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 16:14:17.284608 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 13 16:14:17.325963 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: Python main interpreter initialized at 0x559eac7ba9c0 May 13 16:14:17.325963 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: python threads support enabled May 13 16:14:17.325963 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: your server socket listen backlog is limited to 100 connections May 13 16:14:17.325963 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: your mercy for graceful operations on workers is 90 seconds May 13 16:14:17.326335 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: mapped 403077 bytes (393 KB) for 2 cores May 13 16:14:17.326410 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: *** Operational MODE: preforking *** May 13 16:14:17.326653 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: *** uWSGI is running in multiple interpreter mode *** May 13 16:14:17.326653 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: spawned uWSGI master process (pid: 78792) May 13 16:14:17.326855 dv-cinder-689486-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 16:14:17.328196 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: spawned uWSGI worker 1 (pid: 78793, cores: 1) May 13 16:14:17.328196 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: spawned uWSGI worker 2 (pid: 78794, cores: 1) May 13 16:14:17.328196 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 16:14:18.920328 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:14:18.920328 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: from cryptography.utils import int_from_bytes May 13 16:14:18.920967 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:14:18.920967 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: from cryptography.utils import int_from_bytes May 13 16:14:18.921426 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:14:18.921426 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: from cryptography.utils import int_from_bytes May 13 16:14:18.921540 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:14:18.921540 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: from cryptography.utils import int_from_bytes May 13 16:14:21.476616 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 16:14:21.477291 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 16:14:21.477684 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 16:14:21.477780 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 16:14:21.477857 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 16:14:21.477930 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 16:14:21.478006 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 16:14:21.478086 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 16:14:21.478163 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 16:14:21.478237 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 16:14:21.478308 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.478535 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.478876 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.478982 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.479236 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.479332 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.479615 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.479707 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.479908 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480015 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480424 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480520 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480595 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480754 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480831 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480904 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.480970 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481041 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481162 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481242 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481320 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481554 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481658 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-689486-12-iscsi {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481749 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-689486-12-iscsi {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.481951 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482071 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482258 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482378 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482567 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482684 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482881 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.482998 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483185 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483287 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483513 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483621 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483815 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.483915 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.484310 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.484432 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.484734 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.484848 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485037 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485162 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485370 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485526 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485687 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485779 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.485999 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486095 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486312 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486429 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486622 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486731 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.486927 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487019 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487244 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487335 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487549 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487646 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.487867 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-689486-12-iscsi {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.488009 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-689486-12-iscsi {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.488177 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.488314 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489036 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489206 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489381 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489470 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489801 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.489901 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490111 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490248 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490417 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490514 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490733 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.490837 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491052 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491187 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491371 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491458 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491681 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491776 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.491996 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492080 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492312 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492411 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492629 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492728 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.492927 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493018 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493254 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493353 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493560 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493662 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493877 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.493969 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494178 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494269 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494477 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494569 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494726 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.494863 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495032 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495136 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495350 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495436 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495668 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495760 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.495984 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496078 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496236 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496335 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496486 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496618 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496788 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.496916 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497123 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497296 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497442 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497580 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497733 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.497881 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498027 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498172 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498331 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498479 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498632 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498779 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.498919 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.499058 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.499470 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.499610 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.499758 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.499905 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500052 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500198 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500348 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500498 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500654 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500804 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.500979 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501160 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501313 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501459 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501655 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501803 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.501944 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502082 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502221 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502374 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502543 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502684 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502824 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.502963 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503102 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503249 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503397 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503535 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503711 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.503863 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504056 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504210 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504369 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504621 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504767 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.504912 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505192 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505350 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505498 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505638 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505786 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.505931 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506084 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506232 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506381 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506527 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506678 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.506846 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507148 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507297 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507437 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507575 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507714 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.507852 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508000 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508147 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508287 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508426 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508571 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508721 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.508872 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509018 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509193 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509347 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509493 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509643 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509792 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.509931 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510069 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510214 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510354 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510616 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510772 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.510911 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511050 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511188 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511326 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511481 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511658 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.511875 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512093 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512312 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512496 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512676 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512843 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.512999 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513178 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513356 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513511 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513652 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513842 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.513987 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514132 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514271 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514417 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514565 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514713 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.514871 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515018 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515157 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515295 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515443 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515591 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515735 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.515873 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516011 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516149 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516296 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516441 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516588 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516738 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.516877 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517021 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517280 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517427 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517565 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517704 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517849 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.517995 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518147 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518293 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518432 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518577 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518728 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.518877 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519017 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519162 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519302 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519440 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519599 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519763 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.519935 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520075 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520220 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520360 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520498 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520669 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.520867 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521027 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521212 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521354 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521493 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521641 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521781 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:14:21.521921 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522067 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522220 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522370 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522516 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522667 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522813 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.522953 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523090 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523239 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523381 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523572 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523722 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.523861 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524016 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524170 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524310 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524459 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524599 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524793 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.524951 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525118 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525266 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525405 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525554 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525703 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525853 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.525992 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.526138 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.526277 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.526427 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.526587 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.526813 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527016 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527164 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527399 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527554 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527705 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.527923 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528073 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528214 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528364 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528504 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528662 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528811 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.528951 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529144 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529302 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529443 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529589 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529740 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.529894 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.530121 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.530334 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.530598 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.530763 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.530915 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531062 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531203 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531343 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531482 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531634 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531783 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.531932 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532071 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532210 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532350 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532499 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532658 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532799 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.532939 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533109 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533257 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533409 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533550 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533689 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533827 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.533965 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534103 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534251 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534392 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534549 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534689 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534828 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.534966 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.535114 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.535763 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.535922 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536083 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536231 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536385 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536528 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536667 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536806 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.536964 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537150 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537313 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537541 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537690 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537829 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.537988 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538134 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538284 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538434 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538574 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538714 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.538853 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539007 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539156 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539297 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539437 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539576 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539723 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.539871 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540011 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540150 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540288 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540427 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540573 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540735 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.540875 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541015 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541176 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541316 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541454 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541605 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541747 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.541892 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542039 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542185 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542332 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542481 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542632 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542772 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.542912 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543050 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543197 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543444 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543596 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543736 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.543883 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544023 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544172 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544311 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544450 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544598 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544738 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.544876 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545025 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545189 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545331 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545507 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545667 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545808 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.545957 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546097 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546236 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546375 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546531 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546671 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546820 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.546960 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547106 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547246 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547385 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547543 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547763 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.547916 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548065 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548204 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548343 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548516 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548658 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548804 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.548951 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549120 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549266 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549418 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549566 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549706 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549852 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.549992 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550131 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550284 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550440 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550582 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550721 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.550859 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.551676 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.551834 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.551976 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552115 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552264 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552403 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552557 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552697 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.552847 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553000 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553172 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553328 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553479 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553619 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553758 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.553897 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554044 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554184 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554340 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554481 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554620 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554770 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.554910 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555056 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555204 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555345 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555486 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555635 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555775 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.555920 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.556070 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.556782 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.556870 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.556950 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557149 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557237 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557316 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557395 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557474 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557563 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557652 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557755 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557838 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.557925 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558005 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558102 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558323 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558415 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558495 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558574 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558659 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558745 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558833 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558914 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.558992 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559070 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559240 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559341 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559549 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559636 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559864 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.559954 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560190 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560287 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560502 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560589 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560825 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.560912 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561168 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561274 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561477 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561565 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561781 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.561866 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562107 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562208 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562416 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562501 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562719 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.562805 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563024 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563123 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563327 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563414 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563668 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563755 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.563977 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564072 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564280 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564380 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564593 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564679 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.564914 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565001 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565244 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565348 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565560 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565694 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565868 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.565957 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566177 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566272 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566523 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566619 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566844 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.566941 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567153 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567240 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567468 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567556 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567781 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.567870 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568093 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568179 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568403 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568529 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568721 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.568807 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569032 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569152 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569366 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569469 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569675 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569761 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.569979 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.570066 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.570288 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.570386 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.570600 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.570685 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571179 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571267 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571513 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571608 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571829 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.571962 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572147 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572234 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572465 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572552 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572783 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.572868 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573134 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573238 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573458 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573545 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573771 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.573875 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574078 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574224 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574374 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574517 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574679 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574817 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.574983 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575123 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575293 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575447 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575583 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575751 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.575899 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576056 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576192 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576338 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576470 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576612 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576754 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.576928 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577063 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577303 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577455 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577613 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577704 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.577922 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578013 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578241 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578331 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578553 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578651 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578856 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.578952 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579163 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579247 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579477 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579562 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579782 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.579868 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580088 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580184 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580386 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580482 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580690 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.580776 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581019 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581144 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581355 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581459 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581692 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.581785 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582018 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582125 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582400 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582496 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582713 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.582800 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583023 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583118 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583342 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583436 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583648 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583751 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.583952 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584041 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584259 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584348 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584564 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584657 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584872 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.584964 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585198 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585288 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585519 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585613 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585831 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.585967 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586137 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586239 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586443 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586541 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586746 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.586833 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587052 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587137 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587357 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587451 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587661 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587754 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.587964 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588049 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588270 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588366 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588582 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588707 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588887 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.588990 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589216 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589316 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589533 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589630 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589837 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.589934 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590139 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590228 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590439 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590524 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590741 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.590827 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591049 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591144 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591359 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591446 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591673 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591759 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.591977 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592083 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592285 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592390 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592584 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592683 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592886 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.592980 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593213 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593306 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593521 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593622 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593826 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.593915 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594128 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594215 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594427 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594564 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594728 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.594815 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595049 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595136 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595330 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595427 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595650 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595737 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.595958 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596137 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596284 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596435 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596582 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596719 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596856 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.596992 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.597181 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.597332 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.597472 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.597610 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.598457 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.598604 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.598843 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.598978 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599117 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599254 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599399 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599538 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599638 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599716 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.599958 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600075 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600260 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600355 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600568 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600655 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600877 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.600963 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601209 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601300 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601516 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601605 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601821 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.601918 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602126 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602226 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602442 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602546 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602749 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.602871 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603059 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603158 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603380 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603467 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603702 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.603789 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604004 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604101 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604314 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604402 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604622 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604709 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.604928 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605023 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605261 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605358 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605573 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605671 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605879 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.605967 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606192 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606299 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606502 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606597 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606813 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.606901 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607124 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607211 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607432 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607517 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607740 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.607828 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608046 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608140 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608353 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608450 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608657 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608746 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.608976 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609063 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609307 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609397 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609618 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609708 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.609924 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610010 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610229 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610325 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610534 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610632 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610838 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.610971 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611275 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611382 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611589 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611683 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611898 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.611986 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612203 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612299 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612518 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612678 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612842 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.612988 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.613161 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.613332 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.613494 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.614136 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.614292 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.614491 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.614717 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.614818 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615033 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615128 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615347 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615434 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615661 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615756 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.615975 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616063 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616285 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616372 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616599 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616688 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616903 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.616988 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617233 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617324 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617540 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617637 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617847 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.617937 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618152 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618245 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618467 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618555 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618790 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.618878 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619185 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619293 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619490 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619578 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619803 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.619898 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620209 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620304 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620521 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620624 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620828 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.620932 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621175 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621283 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621503 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621590 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621809 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.621895 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622121 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622216 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622431 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622518 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622743 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.622841 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623067 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623154 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623382 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623476 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623696 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.623787 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624000 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624353 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624564 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624681 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624890 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.624985 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625231 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625321 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625548 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625635 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625880 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.625974 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.626274 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.626439 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.626587 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.626664 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.626910 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.627019 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.627255 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.627467 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.627867 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628102 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628278 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628398 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628603 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628790 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628790 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.628982 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629070 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629300 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629387 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629467 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629546 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629625 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629704 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.629793 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630000 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630090 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630313 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630409 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630624 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630722 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.630988 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631090 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631237 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631326 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631561 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631650 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631868 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.631963 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632193 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632288 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632504 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632592 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632825 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.632925 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633153 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633319 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633474 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633619 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633758 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.633893 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634067 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634212 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634354 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634497 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634661 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634794 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.634965 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635097 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635300 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635436 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635604 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635694 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.635931 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636019 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636259 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636374 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636570 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636675 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636883 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.636981 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637331 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637433 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637555 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637643 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637870 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.637975 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638191 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638294 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638496 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638583 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638803 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.638898 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639108 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639203 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639410 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639501 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639715 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.639812 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640018 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640142 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640322 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640413 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640623 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640746 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.640926 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641022 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641250 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641352 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641553 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641640 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641866 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.641961 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642170 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642258 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642486 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642574 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642793 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.642989 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643081 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643161 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643391 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643476 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643699 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.643800 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644021 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644108 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644331 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644426 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644696 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.644789 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645018 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645136 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645370 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645494 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645705 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.645795 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646018 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646116 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646337 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646433 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646654 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646743 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.646968 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647055 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647282 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647378 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647596 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647686 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647907 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.647994 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648220 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648316 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648528 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648628 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648834 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.648921 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.649169 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.649261 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.649486 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.649598 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.649805 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650018 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650337 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650428 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650693 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650799 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.650963 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651061 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651273 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651362 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651586 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651684 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651898 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.651987 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652210 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652304 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652520 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652609 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652831 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.652931 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.653161 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.653254 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.653477 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.653575 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654280 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654408 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654408 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654558 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654637 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654724 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654812 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.654901 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655074 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655163 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655388 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655477 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655706 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.655793 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656028 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656117 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656373 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656460 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656681 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656770 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.656991 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657143 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657336 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657507 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657656 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657752 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.657972 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658067 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658284 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658381 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658598 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658695 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658910 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.658997 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659226 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659372 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659535 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659632 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659842 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.659929 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.660154 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.660778 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661190 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661294 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661439 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661527 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661782 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.661870 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662098 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662187 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662413 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662523 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662729 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.662826 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663044 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663248 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663561 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663663 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663880 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.663979 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664212 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664306 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664534 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664633 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664848 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.664936 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665190 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665283 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665514 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665675 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665822 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.665917 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666127 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666238 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666434 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666531 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666740 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.666868 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667049 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667176 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667350 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667438 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667662 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667749 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.667967 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668062 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668270 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668358 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668581 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668695 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.668889 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.669132 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.669456 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.669547 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.669788 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.669893 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670117 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670248 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670439 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670530 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670758 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.670848 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671069 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671167 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671379 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671466 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671694 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671798 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.671999 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672101 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672308 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672395 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672617 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672703 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.672922 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673024 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673252 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673343 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673565 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673669 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673874 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.673996 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674176 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674266 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674481 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674567 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674784 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.674880 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675089 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675184 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675401 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675488 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675711 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.675822 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.676571 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.676664 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.676897 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677015 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677221 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677347 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677534 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677705 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677840 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.677960 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678146 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678264 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678451 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678532 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678768 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.678901 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679075 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679165 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679386 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679485 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679690 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.679818 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680004 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680094 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680311 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680400 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680617 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680755 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.680924 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681040 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681260 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681349 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681566 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681668 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681871 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.681966 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682181 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682268 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682490 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682587 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682803 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.682891 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683114 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683202 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683425 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683522 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683765 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.683859 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.684082 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.684302 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.684617 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.684707 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.684950 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685045 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685295 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685395 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685641 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685738 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.685959 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686088 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686266 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686363 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686574 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686674 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686879 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.686984 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687244 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687349 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687503 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687594 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687810 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.687896 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.688118 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.688318 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.688630 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.688718 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.688959 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689061 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689275 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689375 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689586 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689674 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689899 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.689999 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690206 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690303 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690514 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690611 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690849 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.690935 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691167 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691282 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691515 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691621 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691871 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.691972 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692191 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692281 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692504 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692599 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692815 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.692911 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693148 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693240 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693467 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693625 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693779 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.693921 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694098 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694250 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694389 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694527 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694706 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.694851 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695114 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695258 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695434 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695573 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695756 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.695907 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696052 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696200 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696376 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696517 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696725 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.696868 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.697057 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.697549 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.697709 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.697860 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698002 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698155 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698295 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698434 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698583 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698722 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.698869 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699009 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699009 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699286 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699286 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699550 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699696 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699835 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.699972 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700107 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700257 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700396 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700539 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700674 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700813 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.700950 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701104 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701206 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701378 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701489 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701691 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.701790 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702012 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702110 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702325 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702441 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702635 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702733 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.702944 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703050 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703258 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703354 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703567 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703684 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703882 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.703986 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704184 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704273 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704498 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704585 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704806 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.704906 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705138 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705263 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705459 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705559 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705779 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.705887 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706100 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706187 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706412 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706499 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706732 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.706820 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707039 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707154 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707381 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707481 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707704 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.707800 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708028 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708115 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708347 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708434 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708659 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708748 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.708993 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709123 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709329 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709415 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709642 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709737 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.709953 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710056 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710265 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710373 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710572 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710678 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710880 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.710968 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711205 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711302 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711511 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711606 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711827 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.711914 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712145 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712241 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712460 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712553 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712775 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.712869 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713114 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713218 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713422 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713511 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713741 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.713839 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714055 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714163 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714365 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714455 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714675 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.714767 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715017 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715119 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715291 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715378 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715603 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715699 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.715932 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716021 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716256 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716342 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716582 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716686 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716909 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.716997 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.717258 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.717348 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.717583 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.717688 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.717916 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.718006 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.718158 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 16:14:21.718247 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:14:21.718473 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 16:14:21.752328 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_db.sqlalchemy.engines [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:21.752946 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_db.sqlalchemy.engines [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:21.994598 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.context [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea(cell1) {{(pid=78794) load_cells /opt/stack/nova/nova/context.py:464}} May 13 16:14:21.996992 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.context [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea(cell1) {{(pid=78793) load_cells /opt/stack/nova/nova/context.py:464}} May 13 16:14:21.998880 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_concurrency.lockutils [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:14:22.000781 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_concurrency.lockutils [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:14:22.001583 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:14:22.001759 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_concurrency.lockutils [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:14:22.003285 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:14:22.003555 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_concurrency.lockutils [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:14:22.004072 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:14:22.006142 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:14:22.026829 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_db.sqlalchemy.engines [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.035162 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_db.sqlalchemy.engines [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.036532 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_db.sqlalchemy.engines [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.037406 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_db.sqlalchemy.engines [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.061014 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG oslo_db.sqlalchemy.engines [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.068375 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_db.sqlalchemy.engines [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:14:22.673887 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: WARNING keystonemiddleware.auth_token [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:14:22.680599 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: WARNING keystonemiddleware.auth_token [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:14:22.728802 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: WARNING keystonemiddleware.auth_token [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:14:22.735473 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: WARNING keystonemiddleware.auth_token [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:14:22.894478 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: WARNING keystonemiddleware.auth_token [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:14:22.900210 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: WARNING keystonemiddleware.auth_token [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:14:22.905513 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559eac7ba9c0 pid: 78794 (default app) May 13 16:14:22.907593 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:14:22.908709 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001652 May 13 16:14:22.909144 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 789 bytes} [Thu May 13 16:14:22 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:14:22.948376 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: WARNING keystonemiddleware.auth_token [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:14:22.953603 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: WARNING keystonemiddleware.auth_token [None req-339ad3ee-14bf-4be8-b8de-5aad3894b4ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:14:22.958947 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559eac7ba9c0 pid: 78793 (default app) May 13 16:15:49.978869 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:15:49.980957 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002632 May 13 16:15:49.981825 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:15:49 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:15:50.575146 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-54faed97-1c83-42f4-9a6c-62ea1a0c7c28 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:15:50.721523 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-54faed97-1c83-42f4-9a6c-62ea1a0c7c28 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.730283 May 13 16:15:50.722569 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 13 16:15:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:15:53.200515 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:15:53.201590 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-967793de-404f-4e1e-87ed-439ce2d8d0a6 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 13 16:15:53.202281 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:15:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:15:53.293259 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-fd5ce84c-4877-4c88-8b4d-5e74a3a65a45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:53.331572 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:15:53.331572 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:15:53.443590 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-fd5ce84c-4877-4c88-8b4d-5e74a3a65a45 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.231016 May 13 16:15:53.444541 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:15:53 2021] POST /compute/v2.1/flavors => generated 407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:15:53.682354 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-53231853-91cd-4e0b-a5cc-e0cd63213e09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:53.685005 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:15:53.685005 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: warnings.warn(msg) May 13 16:15:54.009245 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-53231853-91cd-4e0b-a5cc-e0cd63213e09 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.527384 May 13 16:15:54.009245 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 13 16:15:53 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:15:56.643405 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-fd5ce84c-4877-4c88-8b4d-5e74a3a65a45 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:15:56.644448 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-fd5ce84c-4877-4c88-8b4d-5e74a3a65a45 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 13 16:15:56.645152 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:15:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:15:56.757108 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-64ad3e46-64fd-4d6a-983f-37a70a7128c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:56.775697 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:15:56.775697 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: warnings.warn(msg) May 13 16:15:56.921126 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-64ad3e46-64fd-4d6a-983f-37a70a7128c2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.269907 May 13 16:15:56.921662 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:15:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:15:56.933446 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-870fea64-b3f4-4632-828c-c625dba198d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:56.934957 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:15:56.934957 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:15:57.048871 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-870fea64-b3f4-4632-828c-c625dba198d4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119180 May 13 16:15:57.049511 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 13 16:15:56 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:15:59.248682 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-64ad3e46-64fd-4d6a-983f-37a70a7128c2 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:15:59.249733 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-64ad3e46-64fd-4d6a-983f-37a70a7128c2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 13 16:15:59.250853 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:15:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:15:59.309850 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-10dc3c9e-75ad-48a1-86a9-d1ef29e74c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:59.422645 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-10dc3c9e-75ad-48a1-86a9-d1ef29e74c09 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165505 May 13 16:15:59.423558 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:15:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:15:59.435707 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-656c60c1-9939-495f-9725-23f5327aad07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:15:59.548241 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-656c60c1-9939-495f-9725-23f5327aad07 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116444 May 13 16:15:59.549941 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 13 16:15:59 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:01.925016 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-10dc3c9e-75ad-48a1-86a9-d1ef29e74c09 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:01.926164 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-10dc3c9e-75ad-48a1-86a9-d1ef29e74c09 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 May 13 16:16:01.926635 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:01.985843 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-14b7f111-4977-4b9d-a5cb-534472330806 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds2G", "ram": 2048}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:02.084566 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-14b7f111-4977-4b9d-a5cb-534472330806 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151716 May 13 16:16:02.085147 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:16:02.097402 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-131bbb8e-b53f-426a-a804-a9b2a34ee178 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:02.238540 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-131bbb8e-b53f-426a-a804-a9b2a34ee178 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145345 May 13 16:16:02.239132 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 13 16:16:02 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:04.429054 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-14b7f111-4977-4b9d-a5cb-534472330806 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:04.430087 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-14b7f111-4977-4b9d-a5cb-534472330806 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 13 16:16:04.430665 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:04.492267 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:04.592500 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155632 May 13 16:16:04.593316 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:16:04.604720 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-3f32f974-e7eb-47cc-bcdd-ef4efc5bc3ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:04.816010 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-3f32f974-e7eb-47cc-bcdd-ef4efc5bc3ef admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.214938 May 13 16:16:04.817335 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Thu May 13 16:16:04 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:07.006718 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:07.007749 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 13 16:16:07.008150 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:16:07.064630 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-6f15641b-6b10-422a-8d54-82761a468ebd admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:07.086468 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-6f15641b-6b10-422a-8d54-82761a468ebd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.072335 May 13 16:16:07.087112 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 13 16:16:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:16:09.247858 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:09.248891 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-db107895-c06e-4266-b84f-11a7868a1689 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 13 16:16:09.249336 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:09.318093 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-73d95426-28fc-455b-8a28-9e25e1eea640 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:09.408000 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-73d95426-28fc-455b-8a28-9e25e1eea640 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.151868 May 13 16:16:09.408570 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:09 2021] POST /compute/v2.1/flavors => generated 402 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:16:09.420792 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-a1795f74-c4e0-4348-bcc7-7ed1278f1900 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:09.620398 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-a1795f74-c4e0-4348-bcc7-7ed1278f1900 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.203681 May 13 16:16:09.628220 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 13 16:16:09 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:11.800857 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-73d95426-28fc-455b-8a28-9e25e1eea640 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:11.801859 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-73d95426-28fc-455b-8a28-9e25e1eea640 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 13 16:16:11.802268 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:16:11.863261 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-892eb4bf-059d-4c7d-932a-462130a236be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:11.960838 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-892eb4bf-059d-4c7d-932a-462130a236be admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152232 May 13 16:16:11.964532 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:16:11.973571 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-dcaf74a3-18f3-4e1a-b544-29cb1332f07d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:12.132170 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-dcaf74a3-18f3-4e1a-b544-29cb1332f07d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.162061 May 13 16:16:12.132665 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 13 16:16:11 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:14.306641 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-892eb4bf-059d-4c7d-932a-462130a236be admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:14.308157 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-892eb4bf-059d-4c7d-932a-462130a236be admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 13 16:16:14.308157 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:14.371426 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-95d7892a-f292-49cd-8de6-f60a45041a30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:14.463324 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-95d7892a-f292-49cd-8de6-f60a45041a30 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.148120 May 13 16:16:14.463867 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:14 2021] POST /compute/v2.1/flavors => generated 406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:16:14.476563 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-d2c2709a-107e-49ec-81ed-a6b4a79e3691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:14.605538 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-d2c2709a-107e-49ec-81ed-a6b4a79e3691 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132535 May 13 16:16:14.606378 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 13 16:16:14 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:16.815621 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-95d7892a-f292-49cd-8de6-f60a45041a30 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:16.816620 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-95d7892a-f292-49cd-8de6-f60a45041a30 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 13 16:16:16.817420 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:16.875083 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-fb2e5c86-106c-4299-9024-216e5b21c90a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:16.965584 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-fb2e5c86-106c-4299-9024-216e5b21c90a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142157 May 13 16:16:16.966211 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:16 2021] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:16:16.984116 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-95893791-82a1-46ca-9a99-38561163f882 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:17.087438 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-95893791-82a1-46ca-9a99-38561163f882 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112675 May 13 16:16:17.087941 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 13 16:16:16 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:16:19.288827 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-fb2e5c86-106c-4299-9024-216e5b21c90a admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:19.292201 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-fb2e5c86-106c-4299-9024-216e5b21c90a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002500 May 13 16:16:19.292201 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:19 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:19.381613 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "swap": 0}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:19.464219 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.164364 May 13 16:16:19.464802 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Thu May 13 16:16:19 2021] POST /compute/v2.1/flavors => generated 408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:16:19.476867 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-2cdbe49d-11e0-49c6-8c08-637bef22076b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:16:19.595761 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-2cdbe49d-11e0-49c6-8c08-637bef22076b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122240 May 13 16:16:19.598759 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Thu May 13 16:16:19 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:16:59.801113 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:59.802130 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 13 16:16:59.802530 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Thu May 13 16:16:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:16:59.858492 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-f7b85ba0-250d-4061-97b7-1c0f29f16e1d admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:16:59.882090 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-f7b85ba0-250d-4061-97b7-1c0f29f16e1d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073646 May 13 16:16:59.882634 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Thu May 13 16:16:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:01.278037 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:01.279694 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-62a106ee-6d47-4bb4-9d26-35fa6ec530ed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 13 16:17:01.280086 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:01.475454 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-95fbd773-08c4-4f8a-83f0-b563b71bb05e admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:01.487919 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.wsgi [None req-95fbd773-08c4-4f8a-83f0-b563b71bb05e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 16:17:01.488428 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-95fbd773-08c4-4f8a-83f0-b563b71bb05e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:01.489265 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-95fbd773-08c4-4f8a-83f0-b563b71bb05e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.071085 May 13 16:17:01.489790 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1191 bytes} [Thu May 13 16:17:01 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 13 16:17:01.499677 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-76ec3291-caa1-4d0b-9f95-dfa68a2cc05c admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:01.520135 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-76ec3291-caa1-4d0b-9f95-dfa68a2cc05c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024147 May 13 16:17:01.520706 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:01.531648 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-1b7f4e52-d4ad-4735-80e1-127d24ba0ea2 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:01.551542 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-1b7f4e52-d4ad-4735-80e1-127d24ba0ea2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024254 May 13 16:17:01.552097 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:01.562403 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-82a6d6cc-2518-4a42-aea5-0a050986cbc7 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:01.574927 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.wsgi [None req-82a6d6cc-2518-4a42-aea5-0a050986cbc7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 16:17:01.575509 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-82a6d6cc-2518-4a42-aea5-0a050986cbc7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:01.576965 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-82a6d6cc-2518-4a42-aea5-0a050986cbc7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.018829 May 13 16:17:01.577526 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1191 bytes} [Thu May 13 16:17:01 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 16:17:02.880134 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-1b7f4e52-d4ad-4735-80e1-127d24ba0ea2 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:02.881154 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-1b7f4e52-d4ad-4735-80e1-127d24ba0ea2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 13 16:17:02.881547 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:03.069376 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-24b3b400-9205-456f-bf5c-b0476ef2694b admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:03.082044 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.wsgi [None req-24b3b400-9205-456f-bf5c-b0476ef2694b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 16:17:03.082617 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-24b3b400-9205-456f-bf5c-b0476ef2694b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:03.083412 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-24b3b400-9205-456f-bf5c-b0476ef2694b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.065397 May 13 16:17:03.083929 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1191 bytes} [Thu May 13 16:17:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 16:17:03.093414 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-4d1979cd-4ed2-42eb-89b7-2146a9d6f973 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:03.112788 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-4d1979cd-4ed2-42eb-89b7-2146a9d6f973 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022988 May 13 16:17:03.113337 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:03.123478 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-bf599b9e-3d03-42fb-b012-03e0a9e19df4 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:03.144457 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-bf599b9e-3d03-42fb-b012-03e0a9e19df4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025232 May 13 16:17:03.145011 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:17:03.154433 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-96446e1d-e535-4845-ba32-7e6c7ce6386f admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:03.166502 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.wsgi [None req-96446e1d-e535-4845-ba32-7e6c7ce6386f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 16:17:03.167068 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-96446e1d-e535-4845-ba32-7e6c7ce6386f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:03.167847 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-96446e1d-e535-4845-ba32-7e6c7ce6386f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017073 May 13 16:17:03.168354 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1191 bytes} [Thu May 13 16:17:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 16:17:04.476152 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-bf599b9e-3d03-42fb-b012-03e0a9e19df4 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:04.477254 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-bf599b9e-3d03-42fb-b012-03e0a9e19df4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 13 16:17:04.477656 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:04.667845 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-1aad26d2-20b3-4c1b-865d-93b57743e41b admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:04.680894 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.wsgi [None req-1aad26d2-20b3-4c1b-865d-93b57743e41b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 16:17:04.681551 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-1aad26d2-20b3-4c1b-865d-93b57743e41b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:04.682302 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-1aad26d2-20b3-4c1b-865d-93b57743e41b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.066969 May 13 16:17:04.682844 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:17:04 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 16:17:04.692547 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-bc15af28-ea9d-4f20-b0b0-bec2d8294888 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:04.712169 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-bc15af28-ea9d-4f20-b0b0-bec2d8294888 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023192 May 13 16:17:04.712721 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:04.722936 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:04.743691 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024361 May 13 16:17:04.744504 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1211 bytes} [Thu May 13 16:17:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:17:04.754153 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-b3687fe3-af98-4b3c-bfd0-609f6fcd0332 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:04.766268 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.wsgi [None req-b3687fe3-af98-4b3c-bfd0-609f6fcd0332 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 16:17:04.769157 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-b3687fe3-af98-4b3c-bfd0-609f6fcd0332 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:17:04.769157 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-b3687fe3-af98-4b3c-bfd0-609f6fcd0332 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017106 May 13 16:17:04.769157 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:17:04 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 16:17:06.082746 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:06.083786 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 13 16:17:06.084192 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:06.272171 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-3a298e68-d1b3-42b6-a96b-2fab61143b58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:17:06.368384 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-3a298e68-d1b3-42b6-a96b-2fab61143b58 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.146834 May 13 16:17:06.369122 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1236 bytes} [Thu May 13 16:17:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:17:07.677059 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:07.678099 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 13 16:17:07.678496 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:07.866703 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-e3dd2e57-815b-4694-807a-b83712c350c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:17:07.953217 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-e3dd2e57-815b-4694-807a-b83712c350c2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.137229 May 13 16:17:07.953755 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1236 bytes} [Thu May 13 16:17:07 2021] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:17:09.267818 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:09.268822 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 13 16:17:09.269254 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:09.458463 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-56537409-3e47-4730-b9c9-4ac966af50c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:17:09.571304 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-56537409-3e47-4730-b9c9-4ac966af50c8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.163723 May 13 16:17:09.571856 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1236 bytes} [Thu May 13 16:17:09 2021] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:17:10.874774 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:10.875778 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 13 16:17:10.876181 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:17:11.068133 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-a31ccb44-44a0-4e12-ae52-88ae7d8d3b34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:17:11.182419 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-a31ccb44-44a0-4e12-ae52-88ae7d8d3b34 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.168405 May 13 16:17:11.182878 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1236 bytes} [Thu May 13 16:17:11 2021] POST /compute/v2.1/flavors => generated 409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:17:12.486981 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:12.487996 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001781 May 13 16:17:12.488393 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:17:12.672771 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-4dcab55b-2c3f-4199-a60a-8cad63dab2d5 admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:12.698338 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-4dcab55b-2c3f-4199-a60a-8cad63dab2d5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076087 May 13 16:17:12.698779 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1203 bytes} [Thu May 13 16:17:12 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:17:57.491034 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:57.492166 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-bbe056a1-7e95-4c9f-bb56-dcaaa55581a4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 May 13 16:17:57.492893 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 31/63] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:17:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:17:57.692662 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:17:57.717847 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.085826 May 13 16:17:57.718389 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1203 bytes} [Thu May 13 16:17:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:19:24.216951 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-26be9fef-218c-4531-9418-0722c2bb08b6 tempest-verify_tempest_config-78080018 tempest-verify_tempest_config-78080018-project] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:19:24.219110 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-26be9fef-218c-4531-9418-0722c2bb08b6 tempest-verify_tempest_config-78080018 tempest-verify_tempest_config-78080018-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119937 May 13 16:19:24.219660 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1134 bytes} [Thu May 13 16:19:24 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:21:08.622235 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:08.623232 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 13 16:21:08.623701 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 34/66] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:21:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:21:08.883643 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:08.884794 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:21:08.884794 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:21:08.886427 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:08.886878 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:08.887658 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:08.888080 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:08.920538 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-28105ac9-ee97-465b-b7df-04616d9b9b1a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.156831 May 13 16:21:08.921106 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:21:08 2021] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:21:10.259657 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:10.260662 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 13 16:21:10.261051 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 35/68] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:21:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:21:10.452820 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:10.454085 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:21:10.454085 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:21:10.455693 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:10.456171 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:10.457047 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:10.457553 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:10.482323 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-c13a65ac-4fd7-46c8-b1e8-5b9b73123c29 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.082510 May 13 16:21:10.482838 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 34/69] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:21:10 2021] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:21:22.238280 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:22.239279 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 May 13 16:21:22.239718 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:21:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:21:22.429566 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:22.430720 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:21:22.430720 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:21:22.432241 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:22.432693 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:22.433542 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:22.433979 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:22.462456 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-9371b308-e5b6-4576-8f10-32d9d405b09c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.084764 May 13 16:21:22.463022 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 35/71] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:21:22 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:21:23.809959 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: DEBUG nova.api.openstack.wsgi [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] Calling method '>' {{(pid=78794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:23.811264 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: INFO nova.api.openstack.requestlog [None req-5e618cec-530f-4724-9f50-0875b9dd531a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 May 13 16:21:23.811717 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: [pid: 78794|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1075 bytes} [Thu May 13 16:21:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:21:24.035142 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG nova.api.openstack.wsgi [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] Calling method '>' {{(pid=78793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:21:24.036513 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:21:24.036513 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: warnings.warn(msg) May 13 16:21:24.038473 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:24.039022 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:24.040020 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:21:24.040570 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: DEBUG oslo_concurrency.lockutils [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:21:24.072950 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: INFO nova.api.openstack.requestlog [None req-5bbe1880-f199-479a-91e0-7b4c601d731a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.091140 May 13 16:21:24.073698 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: [pid: 78793|app: 0|req: 36/73] 10.222.0.42 () {60 vars in 1194 bytes} [Thu May 13 16:21:23 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:22:28.616898 dv-cinder-689486-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 16:22:28.617729 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: Thu May 13 16:22:28 2021 - graceful shutdown triggered... May 13 16:22:28.618182 dv-cinder-689486-12-iscsi devstack@n-api.service[78793]: Gracefully killing worker 1 (pid: 78793)... May 13 16:22:28.618601 dv-cinder-689486-12-iscsi devstack@n-api.service[78794]: Gracefully killing worker 2 (pid: 78794)... May 13 16:22:29.619972 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: worker 1 buried after 1 seconds May 13 16:22:29.619972 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: worker 2 buried after 1 seconds May 13 16:22:29.619972 dv-cinder-689486-12-iscsi devstack@n-api.service[78792]: goodbye to uWSGI. May 13 16:22:29.622216 dv-cinder-689486-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 16:22:29.622770 dv-cinder-689486-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 16:22:29.625653 dv-cinder-689486-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 16:22:29.636404 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 13 16:22:29 2021] *** May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: nodename: dv-cinder-689486-12-iscsi May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: machine: x86_64 May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: clock source: unix May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: pcre jit disabled May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: detected number of CPU cores: 4 May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: current working directory: / May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: detected binary path: /usr/bin/uwsgi-core May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: your processes number limit is 47680 May 13 16:22:29.638596 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: your memory page size is 4096 bytes May 13 16:22:29.639436 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: detected max file descriptor number: 2048 May 13 16:22:29.639436 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: lock engine: pthread robust mutexes May 13 16:22:29.639436 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: thunder lock: enabled May 13 16:22:29.639436 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 16:22:29.639436 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 13 16:22:29.680309 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: Python main interpreter initialized at 0x557bea1e19c0 May 13 16:22:29.680309 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: python threads support enabled May 13 16:22:29.680309 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: your server socket listen backlog is limited to 100 connections May 13 16:22:29.680309 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: your mercy for graceful operations on workers is 90 seconds May 13 16:22:29.680779 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: mapped 403077 bytes (393 KB) for 2 cores May 13 16:22:29.680779 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: *** Operational MODE: preforking *** May 13 16:22:29.681029 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: *** uWSGI is running in multiple interpreter mode *** May 13 16:22:29.681029 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: spawned uWSGI master process (pid: 93633) May 13 16:22:29.681309 dv-cinder-689486-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 16:22:29.681873 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: spawned uWSGI worker 1 (pid: 93648, cores: 1) May 13 16:22:29.682242 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: spawned uWSGI worker 2 (pid: 93649, cores: 1) May 13 16:22:29.693155 dv-cinder-689486-12-iscsi devstack@n-api.service[93633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 16:22:31.483249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:22:31.483249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: from cryptography.utils import int_from_bytes May 13 16:22:31.484030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:22:31.484030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: from cryptography.utils import int_from_bytes May 13 16:22:31.494766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:22:31.494766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: from cryptography.utils import int_from_bytes May 13 16:22:31.495337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 16:22:31.495337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: from cryptography.utils import int_from_bytes May 13 16:22:33.948875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 16:22:33.950192 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 16:22:33.950292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 16:22:33.950632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 16:22:33.950900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 16:22:33.951305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.951643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.951979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.952311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.952658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.952979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.953349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.953682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.954024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.954296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.954625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.954970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-689486-12-iscsi {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.955297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.955618 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.955940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.956271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.956586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.956922 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.957048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 16:22:33.957549 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.957645 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 16:22:33.957843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.957959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 16:22:33.958281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 16:22:33.958548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 16:22:33.958726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.958900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.959057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.959299 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.959674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.959895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.960119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.960344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.960577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.960813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.961037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.961274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.961509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.961728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.961937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.962154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.962378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.962610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.962819 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-689486-12-iscsi {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.963040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.963259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.963491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.963715 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.963925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.964145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.964364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-689486-12-iscsi {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.964581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.964769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.964959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.965180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.965333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.965530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.965697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.965935 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966453 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.966909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967560 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.967926 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.968125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.968305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.968475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.968620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.968778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.969685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.969863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970172 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.970852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.971622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-689486-12-iscsi {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972343 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.972947 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.973920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974512 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.974976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975502 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.975969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976126 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976418 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.976874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977201 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.977965 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978727 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.978880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.979053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.979824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.979982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.980907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.981064 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.981275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.981452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.981706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.981896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982147 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982600 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.982904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983520 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.983977 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.984124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.984356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.984508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.984664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.985065 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.985291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.985460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.985697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.985856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.986960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987571 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.987867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.988954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.989160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.989348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.990970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991129 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991320 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991633 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.991925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992822 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.992970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993149 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.993901 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.994929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995230 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995540 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.995879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.996524 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.996712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.996859 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.997860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998159 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.998906 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.999067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.999213 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.999357 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:33.999518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.000182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.000348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.000511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.000659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.000813 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.000971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.001150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.001312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.001467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.001613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.001766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.001918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.001918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.002213 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.002384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.002621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.002789 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.002945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.003097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.003250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.003405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.003551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.003704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.003850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.004012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.004159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.004311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.004456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.004837 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.005034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.005215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.005385 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.005534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.005693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.005838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.005983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.006126 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.006281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.006427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.006582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.006735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.006896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.007048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.007193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.007421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.007580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.007727 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.007879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.008032 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.008225 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.008397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.008554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.008700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.008845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.008989 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.009182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.009349 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 16:22:34.009498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.009649 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.010353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.010639 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.010808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.010971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.011141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.011297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.011451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.011596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.011789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.012435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.012608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.012866 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013019 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.013964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.014256 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.014403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.014565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.014711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.014958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.015905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016060 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016213 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016670 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.016969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017166 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017320 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017609 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.017916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018151 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.018913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019671 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.019834 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.020589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.020760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.020908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.021995 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.022150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.022322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.022475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.022621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.022767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.023939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.024852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.025253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.025433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.025582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.025755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026262 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026424 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.026883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.027879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028187 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.028946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.029866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.030018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.030735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.030891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031808 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.031961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032472 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032765 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.032909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033053 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033841 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.033996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034449 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.034900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035472 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035639 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.035947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036837 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.036992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.037928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.038967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.039250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.039402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.039558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.039717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.039871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.040023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.040171 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.040916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.041991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.042139 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.042312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.042459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.042612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.042766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.043439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.043719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.043883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044483 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044639 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.044959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.045140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.045310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.045542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.045713 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.045863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046008 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046457 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.046917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047541 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047695 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.047848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048159 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.048914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049736 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.049882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.050026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.050251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.050426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.051393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.051557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.051712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.051884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052513 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.052834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053357 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.053942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054440 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054601 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.054928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.055978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056599 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.056925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.057907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.058061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.058592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.059264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.059422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.059583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.059744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.059895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.060060 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.060211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.060362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.060521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.060700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.061423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.061698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.061865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.062959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.063258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.063417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.063568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.063719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.063877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.064967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.065150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.065309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.065469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.065628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.065807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066386 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.066846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067157 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.067990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.068347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.068347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.068638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.068805 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.068966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069148 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.069956 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070573 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.070897 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.071536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.071726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.071985 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072313 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.072784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073609 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.073776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.074070 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.074422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.074585 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.074738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.074905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075475 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.075956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.076208 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.076376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.076537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.076688 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.076840 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.077988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.078917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079539 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.079854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080165 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080318 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080468 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.080861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.081013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.081447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.081842 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082797 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.082956 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083507 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.083969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.084269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.084269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.084711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.084888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085800 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.085954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.086113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.086369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.086528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.086679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.086853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087246 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087550 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.087862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.088977 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.089263 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.089448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.089605 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.089798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.089967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.090895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.091046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.091209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.091637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.092057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.092227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.092739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.092947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.093144 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.093315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.093542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.093708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.093869 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.094925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095387 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.095854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096590 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096903 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.096903 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097449 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.097931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.098226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.098378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.098551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.098704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.098857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099727 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.099888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.100988 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.101157 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.101328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.101501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.101920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.102316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.102483 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.102645 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.102927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103088 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.103854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104493 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104806 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.104806 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.105903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.106995 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107149 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107467 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.107930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.108924 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.109124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.109298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.109463 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.109616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.110032 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.110223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.110380 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.110683 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.110881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.111039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.111201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.111362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.111515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.111991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.112174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.112547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.112717 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.112872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113825 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.113978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.114922 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.115998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.116233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.116391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.116551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.116705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.116958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117147 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117639 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.117800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.118100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.118263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.118423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.118423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.118738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.119893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120390 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.120863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.121073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.121789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.122198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.122369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.122369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.122935 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.123096 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.123372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.123542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.123696 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.123854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124008 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.124791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.125114 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.125289 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.125444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.125757 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.125918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126581 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126741 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.126893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.127966 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128126 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128288 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128440 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.128909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.129918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.130714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.131963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.132362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.132525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.132925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.133114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.133284 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.133559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.133719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.133871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134179 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134826 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.134986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.135139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.135139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.135444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.135606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.135777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.136879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.137945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.138901 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.139840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140313 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.140767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.141004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.141223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.141537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.141712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.141868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.142031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.142211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.142594 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.142772 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.143159 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.143324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.143486 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.143752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.143911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.144100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.144100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.144623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.144788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.144951 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.145921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.146209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.146380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.146532 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.146694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.146855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147576 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.147891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148196 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148526 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148688 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.148849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149691 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.149842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.150948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151260 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.151882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.152034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.152193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.152404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.152817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.152977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.153404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.153613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.153804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154239 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.154888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155678 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.155843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156165 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156442 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.156942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.157169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.157328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.157595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.157755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.157995 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.158178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.158333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.158493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.158646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.159845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160334 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.160963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161629 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.161959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.162113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.162265 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.162671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.163108 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.163288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.163741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.163908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.164088 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.164364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.164531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.164701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.164864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.165030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.165236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.165402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.165564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.166799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.166975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.167138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.167291 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.167509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.167791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.168514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.168687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.168852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169370 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.169998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.170969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.171939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172252 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.172896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.173388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.173977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.174150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.174150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.174600 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.174775 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.174930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175387 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.175872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.176780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.177259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.177426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.177591 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.177763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.178023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.178202 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.178604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.178761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.178924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.179077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.179228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.179392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.179545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.179860 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180585 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180738 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.180892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181047 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181208 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181495 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.181958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.182994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.183145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.183603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.183889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.184094 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.184237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.184388 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.185979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186572 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.186861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187351 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187506 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.187827 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.188931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189077 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.189926 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190111 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190196 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.190944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191302 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191388 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191577 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.191944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.192928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.193921 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194481 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194852 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.194948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195572 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195666 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.195947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196390 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.196913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197729 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197819 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.197998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198225 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198882 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.198968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.199985 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200083 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200255 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200434 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200658 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.200963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201154 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.201973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.202950 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.203901 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204806 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.204917 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205027 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205682 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205795 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.205955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206308 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206678 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.206911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207140 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.207814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.208761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.209626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.210646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.211597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.212447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.213248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.213248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.213248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.213248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 16:22:34.213248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 16:22:34.231422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.248498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_db.sqlalchemy.engines [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.574015 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.context [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea(cell1) {{(pid=93648) load_cells /opt/stack/nova/nova/context.py:464}} May 13 16:22:34.578767 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:22:34.580530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:22:34.581672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:22:34.583443 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:22:34.600598 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.context [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea(cell1) {{(pid=93649) load_cells /opt/stack/nova/nova/context.py:464}} May 13 16:22:34.605151 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:22:34.607473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:22:34.608407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:22:34.611092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:22:34.611409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.614446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.638448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_db.sqlalchemy.engines [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.640295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_db.sqlalchemy.engines [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.645292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.669810 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_db.sqlalchemy.engines [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 16:22:34.962142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: WARNING keystonemiddleware.auth_token [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:22:34.969666 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: WARNING keystonemiddleware.auth_token [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:22:34.982733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: WARNING keystonemiddleware.auth_token [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:22:34.989764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: WARNING keystonemiddleware.auth_token [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:22:35.193315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: WARNING keystonemiddleware.auth_token [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:22:35.198780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: WARNING keystonemiddleware.auth_token [None req-ec2495f7-df92-4cf7-a464-08ef68d31e5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:22:35.204845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bea1e19c0 pid: 93648 (default app) May 13 16:22:35.210879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: WARNING keystonemiddleware.auth_token [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 16:22:35.218711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: WARNING keystonemiddleware.auth_token [None req-88cf0ac6-c841-46b6-925a-aebd9cf1ba93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 16:22:35.221702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bea1e19c0 pid: 93649 (default app) May 13 16:23:11.289124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-12a9ccc3-61c3-4930-a496-f51e8b32f428 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Action: 'create', calling method: .version_select at 0x7ffa8dfccb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1709975038", "metadata": {"Type": "work"}}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:13.304937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-12a9ccc3-61c3-4930-a496-f51e8b32f428 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.782964 May 13 16:23:13.305866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Thu May 13 16:23:09 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3786 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 16:23:13.723816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c0f7b374-1393-486c-8b45-326d84437099 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Calling method '.version_select at 0x7ffa8df4daf0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:14.281597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-799ff5e3-1794-40b1-8cdf-253f345903e5 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8ddd11f0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:14.445918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c0f7b374-1393-486c-8b45-326d84437099 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399" status: 200 len: 354 microversion: 2.1 time: 1.129021 May 13 16:23:14.445918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:13 2021] GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 => generated 354 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:14.458588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3fd0214a-4108-47cb-bd66-1cb90bdf0cbb tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Calling method '.version_select at 0x7ffa8de191f0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:14.496084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-799ff5e3-1794-40b1-8cdf-253f345903e5 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/763bd7e4-bc9e-40fe-8d7d-a29fde25cbc5" status: 200 len: 350 microversion: 2.1 time: 0.222105 May 13 16:23:14.497042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:14 2021] GET /compute/v2.1/os-volumes/763bd7e4-bc9e-40fe-8d7d-a29fde25cbc5 => generated 350 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:14.589713 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3fd0214a-4108-47cb-bd66-1cb90bdf0cbb tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399" status: 200 len: 354 microversion: 2.1 time: 0.136355 May 13 16:23:14.591254 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:14 2021] GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:14.611043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6375e83a-34be-46a4-b140-55d786ba6f48 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Calling method '.version_select at 0x7ffa8ddd1af0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:14.995987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6375e83a-34be-46a4-b140-55d786ba6f48 tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399" status: 202 len: 0 microversion: 2.1 time: 0.388165 May 13 16:23:14.997490 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:23:14 2021] DELETE /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:23:15.010271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-899f75ee-aca6-4b97-a327-d821f8bf0bfa tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Calling method '.version_select at 0x7ffa8de19a60>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:15.175363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-899f75ee-aca6-4b97-a327-d821f8bf0bfa tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399" status: 200 len: 353 microversion: 2.1 time: 0.165994 May 13 16:23:15.175363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:15 2021] GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:16.187992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-98bcd056-75ef-4ee8-9c13-4b325cf049ac tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Calling method '.version_select at 0x7ffa8ddcb3a0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:16.391733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-98bcd056-75ef-4ee8-9c13-4b325cf049ac tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] HTTP exception thrown: Volume 7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 could not be found. May 13 16:23:16.391733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-98bcd056-75ef-4ee8-9c13-4b325cf049ac tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] Returning 404 to user: Volume 7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:23:16.391733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-98bcd056-75ef-4ee8-9c13-4b325cf049ac tempest-VolumesGetTestJSON-2012272921 tempest-VolumesGetTestJSON-2012272921-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399" status: 404 len: 109 microversion: 2.1 time: 0.207711 May 13 16:23:16.391733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:16 2021] GET /compute/v2.1/os-volumes/7f71a5c8-c3bd-4c5e-8fa6-c128f131f399 => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:23:17.067916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126272917", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "364f9ea7-bb68-4d81-80ce-70cec45c9d8c"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:17.288333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] validate_networks() for [('364f9ea7-bb68-4d81-80ce-70cec45c9d8c', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:23:17.317889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1172396508", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "f1f0f615-496d-4ef5-853c-e207544002d8"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:17.549773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] validate_networks() for [('f1f0f615-496d-4ef5-853c-e207544002d8', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:23:18.896332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:23:18.898130 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:23:18.906046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:23:18.909635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:23:18.909635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:23:18.952208 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:18.954159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:18.957474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:18.958222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:19.041437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:19.062978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for user 4884755f5b1a48cb8e5ff82429a30a31 and project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:19.098616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:23:19.114357 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:23:19.374932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:23:19.375816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:23:19.376679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:23:19.377553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:23:19.378111 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:23:19.421545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:19.424217 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:19.425268 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:19.429624 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:19.437955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4a57ebad-2cae-409f-9ed2-ac4aedbf263c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.462547 May 13 16:23:19.439516 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 4/8] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:23:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:23:19.451884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d92b2a4d-e180-4853-9ff5-30e428e9f859 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dd51670>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:19.554699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Getting quotas for project 3600688833b844a9be98f7c1d64ba378. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:19.575101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Getting quotas for user 5de8697706fb49229bedfe9dbe29950a and project 3600688833b844a9be98f7c1d64ba378. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:19.626051 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:23:19.635388 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:23:19.710118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d92b2a4d-e180-4853-9ff5-30e428e9f859 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cc23f46c-a0d7-4c6b-9597-034baf9992b7" status: 200 len: 350 microversion: 2.1 time: 0.265162 May 13 16:23:19.719421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:19 2021] GET /compute/v2.1/os-volumes/cc23f46c-a0d7-4c6b-9597-034baf9992b7 => generated 350 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:19.723109 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-070b2c2f-3aa2-42e4-9f3b-91047a90a167 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:19.723904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-070b2c2f-3aa2-42e4-9f3b-91047a90a167 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:19.861595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f8a3f2c0-2352-4d13-acf9-43b34c9e5f6c tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.468393 May 13 16:23:19.870196 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 5/10] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:23:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 3476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:23:19.880928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-070b2c2f-3aa2-42e4-9f3b-91047a90a167 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:19.891586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-070b2c2f-3aa2-42e4-9f3b-91047a90a167 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1218 microversion: 2.1 time: 0.175061 May 13 16:23:19.894582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:19 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:19.949618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-34ca0c73-8458-4323-97ab-e3090695adb1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:19.951225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-34ca0c73-8458-4323-97ab-e3090695adb1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:20.232954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-34ca0c73-8458-4323-97ab-e3090695adb1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:20.282857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-34ca0c73-8458-4323-97ab-e3090695adb1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1215 microversion: 2.1 time: 0.390733 May 13 16:23:20.285508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:19 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:20.921515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-46e2fc2e-6e70-40d3-ab10-702a39392df6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:20.922342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-46e2fc2e-6e70-40d3-ab10-702a39392df6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:21.185483 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-46e2fc2e-6e70-40d3-ab10-702a39392df6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:21.205783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-46e2fc2e-6e70-40d3-ab10-702a39392df6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1218 microversion: 2.1 time: 0.289165 May 13 16:23:21.206960 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:20 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:21.292698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fb5e4f02-ad3a-4216-9804-dfc9c8956a99 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:21.293447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fb5e4f02-ad3a-4216-9804-dfc9c8956a99 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:21.471024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fb5e4f02-ad3a-4216-9804-dfc9c8956a99 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:21.478715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fb5e4f02-ad3a-4216-9804-dfc9c8956a99 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1215 microversion: 2.1 time: 0.190261 May 13 16:23:21.487286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:21 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:22.094026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4042e652-e271-4814-a0a2-777bf423d34a tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd1820>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:22.244816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4042e652-e271-4814-a0a2-777bf423d34a tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/abade222-8043-4388-b787-a953420a028a" status: 200 len: 351 microversion: 2.1 time: 0.154862 May 13 16:23:22.245902 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:23:22 2021] GET /compute/v2.1/os-volumes/abade222-8043-4388-b787-a953420a028a => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:22.250615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-54c753d9-e6e4-40c9-9bcf-236c1689c3e5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:22.251438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-54c753d9-e6e4-40c9-9bcf-236c1689c3e5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:22.397958 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: .version_select at 0x7ffa8dd77d30>, body: {"keypair": {"name": "tempest-keypair-215245171"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:22.464913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:22.471879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-54c753d9-e6e4-40c9-9bcf-236c1689c3e5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:22.472776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:22.480690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-54c753d9-e6e4-40c9-9bcf-236c1689c3e5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1218 microversion: 2.1 time: 0.233751 May 13 16:23:22.498271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:22 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:22.502875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-533695ac-d824-4924-b9c0-d34068b9b68f tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd33a0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:22.675324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-533695ac-d824-4924-b9c0-d34068b9b68f tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.187902 May 13 16:23:22.676324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1134 bytes} [Thu May 13 16:23:22 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:22.680909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e994988a-068b-4fe5-8062-7603b2460ca2 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:22.681818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e994988a-068b-4fe5-8062-7603b2460ca2 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:22.818716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e994988a-068b-4fe5-8062-7603b2460ca2 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:22.828595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e994988a-068b-4fe5-8062-7603b2460ca2 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1215 microversion: 2.1 time: 0.150894 May 13 16:23:22.842086 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 11/18] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:22 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:22.846964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-afbf8210-447b-49ac-a0ad-ace9717dd70f tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd3820>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.177862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-afbf8210-447b-49ac-a0ad-ace9717dd70f tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.163220 May 13 16:23:23.177862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 12/19] 10.222.0.42 () {58 vars in 1149 bytes} [Thu May 13 16:23:22 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:23.177862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f7a9737d-98a6-4951-949d-a4d9dd5730ec tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd1550>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.232211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f7a9737d-98a6-4951-949d-a4d9dd5730ec tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214781 May 13 16:23:23.234027 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 13/20] 10.222.0.42 () {58 vars in 1134 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:23.245916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5f78c1cf-f22d-4b55-8ebf-c605c21f30ac tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcda1f0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.363373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5f78c1cf-f22d-4b55-8ebf-c605c21f30ac tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122356 May 13 16:23:23.364221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 14/21] 10.222.0.42 () {58 vars in 1167 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:23.396639 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c2df7a52-2402-4478-8425-eeb4a073af94 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd38b0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.443142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:23.452038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:23.480607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f4ffe22f-d681-49a9-9b1d-adcb5d3d642a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.550694 May 13 16:23:23.482299 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 8/22] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 13 16:23:21 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:23.503550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.504807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:23.527699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:23.529422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:23.532646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:23.534378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:23.599501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c2df7a52-2402-4478-8425-eeb4a073af94 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.221136 May 13 16:23:23.600218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 15/23] 10.222.0.42 () {58 vars in 1170 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:23.613622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2af52ec8-9226-4310-866b-c14d5de5e622 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcda160>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.782542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2af52ec8-9226-4310-866b-c14d5de5e622 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.173670 May 13 16:23:23.783886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 16/24] 10.222.0.42 () {58 vars in 1155 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:23.801685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9e15ba25-62de-44e5-9537-129473a8a265 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8dcd1550>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.950602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9e15ba25-62de-44e5-9537-129473a8a265 tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156191 May 13 16:23:23.951811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 17/25] 10.222.0.42 () {58 vars in 1188 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:23.956374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:23.964579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:23.969575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:23.982215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1413f64e-1c80-4409-b129-2130f780099e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1222 microversion: 2.1 time: 0.481221 May 13 16:23:23.995477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 9/26] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1222 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:24.006984 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:24.009471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:24.012037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:24.013385 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-752d1d9f-6281-410a-b866-7fd5ddc41cff tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] Calling method '.version_select at 0x7ffa8d47aca0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:24.014862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:24.202835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-752d1d9f-6281-410a-b866-7fd5ddc41cff tempest-VolumesTestJSON-221442517 tempest-VolumesTestJSON-221442517-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.198574 May 13 16:23:24.209844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 10/27] 10.222.0.42 () {58 vars in 1155 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:24.503560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:24.538219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9562dd0e-10ef-45d7-9ac3-bfc557f52801 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1211 microversion: 2.1 time: 0.580086 May 13 16:23:24.555009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:23 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1211 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:25.006928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:25.008155 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:25.039193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:25.039914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:25.043419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:25.043874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:25.445769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:25.470002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cea3efb5-b98e-4c2b-ba5d-ecb84736ec70 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1214 microversion: 2.1 time: 0.471297 May 13 16:23:25.474852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 11/29] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:24 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1214 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:25.572327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:25.573205 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:25.591390 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:25.592501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:25.593991 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:25.596721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:26.359285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:26.375395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-84098cad-78b0-4ab0-88e1-3363a91fd6a8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1285 microversion: 2.1 time: 0.806675 May 13 16:23:26.375990 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 19/30] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:25 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1285 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:26.492557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:26.493220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:26.509017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:26.513761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:26.514801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:26.515423 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:26.872301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:26.887085 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4891e286-4922-4fbf-a2a4-b84b43ed58d3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1278 microversion: 2.1 time: 0.398137 May 13 16:23:26.891171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 12/31] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:26 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1278 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:27.400202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:27.401566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:27.414793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:27.421837 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:27.422913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:27.423500 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:27.909111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:27.912285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:27.926916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:27.927382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:27.928205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:27.941047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:28.368755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:28.383997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:28.395501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-26d94b0a-9893-4e07-93fe-a7ed3b434dec tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1276 microversion: 2.1 time: 0.490073 May 13 16:23:28.396153 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 13/32] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:27 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1276 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:28.411785 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f071b1f9-eea6-4028-8ce9-7120ca269b36 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1273 microversion: 2.1 time: 1.015778 May 13 16:23:28.412737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 20/33] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:27 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1273 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:29.413448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:29.415008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:29.432452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:29.435026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:29.454274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:29.455090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:29.456192 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:29.457394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:29.459015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:29.459485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:29.475960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:29.475960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:30.038045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:30.064002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-48c969cb-4dbf-4a48-99cf-726786530b3a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1276 microversion: 2.1 time: 0.647572 May 13 16:23:30.064687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 14/34] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:29 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1276 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:30.837037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:30.856114 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d5e817ac-d8e0-42da-8a52-27662b27d702 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 1.427942 May 13 16:23:30.856946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 21/35] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:29 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:31.086310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:31.087134 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:31.118502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:31.118502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:31.118502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:31.118502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:31.454137 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:31.496160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de8ce7f3-8dc6-46fa-802a-479663433605 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1276 microversion: 2.1 time: 0.409787 May 13 16:23:31.516602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 15/36] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:31 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1276 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:31.876923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:31.878658 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:31.895700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:31.899938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:31.901230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:31.903480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:32.524716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:32.525392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:32.553642 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:32.559169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:32.559169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:32.566927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:33.209669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:33.230814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d18dde89-84d8-4af4-89d6-876123a9c418 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.710126 May 13 16:23:33.248253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 16/37] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:32 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:33.264140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-783058093", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbab1dd3-c16a-4a06-aa40-0c41bf95770a"}], "security_groups": [{"name": "tempest-securitygroup--1785671440"}], "key_name": "tempest-keypair-215245171", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:33.302287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:33.316438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f3217544-cb2b-432b-8f7d-57b9db7acb1b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 1.445359 May 13 16:23:33.323686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:31 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:34.078431 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] validate_networks() for [('fbab1dd3-c16a-4a06-aa40-0c41bf95770a', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:23:34.316242 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-22569524", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef0472c0-2e05-40f8-8e9f-047ddefa74ad"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:34.526311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] validate_networks() for [('ef0472c0-2e05-40f8-8e9f-047ddefa74ad', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:23:35.948973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:23:35.949766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:23:35.953468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:23:35.954481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:23:35.958080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:23:36.000921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.001890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.003515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.025298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.072386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:36.087969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:36.109571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:23:36.114266 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:23:36.467187 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4e38df84-1586-4d84-aa6e-07dbfbb01dd1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.216792 May 13 16:23:36.469168 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 17/39] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:23:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 3219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:23:36.493614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:36.493614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:36.529700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.530464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.530946 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.531392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.619082 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:23:36.620345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:23:36.625621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:23:36.625621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:23:36.625621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:23:36.641452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.642062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.642991 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:36.644433 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:36.722737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Getting quotas for project 6fc133c816bd4cc5a3a87f673a4c97d6. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:36.742890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Getting quotas for user 91ae4e984ce94a1f8a1fef9bb53f6cf8 and project 6fc133c816bd4cc5a3a87f673a4c97d6. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:36.785528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:23:36.792175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:23:37.070281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:37.070281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-45213d51-9233-4b7b-9c11-264f50276746 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.593583 May 13 16:23:37.070281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 18/40] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:36 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:37.071222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:37.072889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:37.093950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:37.094970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:37.095947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:37.096537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:37.404274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-48530108-09ae-4897-b245-9fe6d08ca340 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.707685 May 13 16:23:37.449811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 23/41] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:23:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 3709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 16:23:37.449811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b7573ae9-4e43-4bd2-b76b-1364c19df970 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:37.449811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b7573ae9-4e43-4bd2-b76b-1364c19df970 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:37.535130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b7573ae9-4e43-4bd2-b76b-1364c19df970 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:37.557871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b7573ae9-4e43-4bd2-b76b-1364c19df970 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1236 microversion: 2.1 time: 0.151175 May 13 16:23:37.558495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:37 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1236 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:37.831352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:37.867166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-67784f6e-8ac2-46c6-80e4-4617d1954886 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.801972 May 13 16:23:37.869799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:37 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:37.882472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5f54fc15-aaa8-4f2b-8460-c3bfa3f45a02 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:37.887623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5f54fc15-aaa8-4f2b-8460-c3bfa3f45a02 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:37.993145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5f54fc15-aaa8-4f2b-8460-c3bfa3f45a02 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:38.001449 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5f54fc15-aaa8-4f2b-8460-c3bfa3f45a02 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1220 microversion: 2.1 time: 0.130234 May 13 16:23:38.003518 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 20/44] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:37 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:38.259141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-0e326530-b92f-4b1b-bfa2-24a675ec907b req-b083ee3c-31e3-4cd5-8364-c1604d214c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b104ab9f-9762-479e-9288-0481bcd996b2", "tag": "42fb0d7b-d102-4bfa-8c00-e49ba8823bc8"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:38.262861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:38.262861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:23:38.274583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-0e326530-b92f-4b1b-bfa2-24a675ec907b req-b083ee3c-31e3-4cd5-8364-c1604d214c52 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.275194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-0e326530-b92f-4b1b-bfa2-24a675ec907b req-b083ee3c-31e3-4cd5-8364-c1604d214c52 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.314344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-0e326530-b92f-4b1b-bfa2-24a675ec907b req-b083ee3c-31e3-4cd5-8364-c1604d214c52 service nova] Creating event network-changed:42fb0d7b-d102-4bfa-8c00-e49ba8823bc8 for instance b104ab9f-9762-479e-9288-0481bcd996b2 on hv-cinder-68948 May 13 16:23:38.317124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-0e326530-b92f-4b1b-bfa2-24a675ec907b req-b083ee3c-31e3-4cd5-8364-c1604d214c52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=93649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 13 16:23:38.321038 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.326636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.326636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.326636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.333591 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.compute.rpcapi [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 13 16:23:38.334496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] Releasing lock "compute-rpcapi-router" {{(pid=93649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 13 16:23:38.361643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3153fccc-4cde-4f02-897f-6152f46eb223 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.798968 May 13 16:23:38.362850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 25/45] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:38.370061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:38.371320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:38.379804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.383072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.383072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.383072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.458691 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-e49c724b-e898-40ed-b75d-00175c80761a req-ee6b6646-a178-4f6a-9b3a-3d93a570c569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1f5404-fbcb-4bac-88f2-711e68d8e0c1", "tag": "6dbde7a2-50f1-49cf-b87e-608bd10930b3"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:38.460923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:38.460923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:23:38.480456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e49c724b-e898-40ed-b75d-00175c80761a req-ee6b6646-a178-4f6a-9b3a-3d93a570c569 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.480987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e49c724b-e898-40ed-b75d-00175c80761a req-ee6b6646-a178-4f6a-9b3a-3d93a570c569 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.521427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-e49c724b-e898-40ed-b75d-00175c80761a req-ee6b6646-a178-4f6a-9b3a-3d93a570c569 service nova] Creating event network-changed:6dbde7a2-50f1-49cf-b87e-608bd10930b3 for instance 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 on hv-cinder-68948 May 13 16:23:38.521967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e49c724b-e898-40ed-b75d-00175c80761a req-ee6b6646-a178-4f6a-9b3a-3d93a570c569 service nova] Acquired lock "compute-rpcapi-router" {{(pid=93648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 13 16:23:38.524384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.524702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.527350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:38.530808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:38.567481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.compute.rpcapi [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 13 16:23:38.571162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] Releasing lock "compute-rpcapi-router" {{(pid=93648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 13 16:23:38.645223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b86e04fd-218b-4b40-83c9-d2d84c488569 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.579775 May 13 16:23:38.646525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 21/46] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:38.654546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-102960517", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef0472c0-2e05-40f8-8e9f-047ddefa74ad"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:38.758554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] validate_networks() for [('ef0472c0-2e05-40f8-8e9f-047ddefa74ad', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:23:38.958220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:38.972142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c11be9e6-a9fb-4f5b-94f6-aa0e6cb22d43 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.607215 May 13 16:23:38.973610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 26/47] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:38 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:38.989431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:38.990128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:38.999428 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.000257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.001283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.001888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.178114 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:39.186971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-029e5d74-b7e4-42f8-8b11-43d6aa71bded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1240 microversion: 2.1 time: 0.212027 May 13 16:23:39.189378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 27/48] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:38 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1240 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:39.194461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:39.197836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:39.218322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.219028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.219957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.220532 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.678526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:23:39.679520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:23:39.680215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:23:39.680786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:23:39.681438 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:23:39.701185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.703965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.709394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:39.710063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:39.730418 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:39.750173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9d5e674e-fa93-4e2f-9c9b-7a98d4294750 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.554829 May 13 16:23:39.753490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 28/49] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:39 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:39.809423 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Getting quotas for project 6fc133c816bd4cc5a3a87f673a4c97d6. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:23:39.824559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Getting quotas for user 91ae4e984ce94a1f8a1fef9bb53f6cf8 and project 6fc133c816bd4cc5a3a87f673a4c97d6. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:23:39.859754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:23:39.864313 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:23:39.992257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:39.993164 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:40.015187 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.015707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:40.016516 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.021539 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:40.104272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f58b3fc2-116e-455b-8d5a-68f1cab24448 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.455753 May 13 16:23:40.116581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 22/50] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:23:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:23:40.135892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7ae90e39-e32e-4317-9b79-fd33af26d14b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:40.136720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7ae90e39-e32e-4317-9b79-fd33af26d14b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:40.362018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7ae90e39-e32e-4317-9b79-fd33af26d14b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:40.379127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7ae90e39-e32e-4317-9b79-fd33af26d14b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1221 microversion: 2.1 time: 0.258276 May 13 16:23:40.392021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 23/51] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:40 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1221 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:40.405916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:40.407766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:40.426940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.429012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:40.431702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.434271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:40.630846 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:40.640685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1344fde0-d26f-462a-a65a-1a2426797401 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.653434 May 13 16:23:40.649526 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 29/52] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:39 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:40.670330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:40.680261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-212dab89-4c3a-415c-872e-f62383ab768f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1240 microversion: 2.1 time: 0.286566 May 13 16:23:40.690378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 24/53] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:40 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:40.768944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:40.769661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:40.778833 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.779499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:40.783666 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:40.784437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.045993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:41.055832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4d1a4e84-00b2-4962-8745-c17fcef97268 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.291167 May 13 16:23:41.057189 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 30/54] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:40 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:41.398783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:41.399801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:41.409008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.409883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.411014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.411680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.596326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:41.641700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c3a7f681-4c41-471d-a39b-d2fd9fb780ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1225 microversion: 2.1 time: 0.216563 May 13 16:23:41.641700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 25/55] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:41 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1225 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:41.658402 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:41.659072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:41.678474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.679213 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.680194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.680797 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.698481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:41.699356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:41.711524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.712127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.713059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:41.713612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:41.849256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:41.863133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b746d83f-0cef-4505-9f4b-8a9e54d915aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1240 microversion: 2.1 time: 0.168855 May 13 16:23:41.864033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 26/56] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:41 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1240 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:41.927899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:41.937035 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-33c51180-7516-4949-9314-417b0faa4b63 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.282403 May 13 16:23:41.938550 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 31/57] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:41 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:42.073124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:42.073667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:42.083250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.083708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.084703 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.085341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.338758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:42.361692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-15a2115a-0c57-4a9c-8b22-8999f5c22b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.288855 May 13 16:23:42.361692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 27/58] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:42 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:42.629352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:42.629968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:42.640796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.641762 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.642646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.643302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.771866 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:42.780525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-234829a3-fbd2-4f8f-ab7f-b5bfcd2cb08a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1225 microversion: 2.1 time: 0.155314 May 13 16:23:42.781109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:42 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:42.880648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:42.881495 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:42.891830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.892306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.893350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.893861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.955917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:42.962146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:42.976984 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.977480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:42.978299 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:42.978792 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:43.035536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:43.047606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9fcf10fc-0d9f-402d-9634-6421c93fc6aa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1240 microversion: 2.1 time: 0.170722 May 13 16:23:43.048828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 28/60] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:42 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:43.230564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:43.239628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7e9a629b-ab0b-4334-8b7c-271f1d170d9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.288258 May 13 16:23:43.240219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 33/61] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:42 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:43.380348 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:43.383032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:43.398810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:43.399319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:43.400714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:43.406015 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:43.657751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:43.667898 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-104c9a79-0e18-4483-bc01-bc564c171692 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.293846 May 13 16:23:43.668726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 29/62] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:43 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:43.796904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:43.797569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:43.806346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:43.807250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:43.808299 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:43.808960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:43.950521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:43.975451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0387a638-cf1b-4494-8e4e-fcbec9c10a7d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1225 microversion: 2.1 time: 0.182376 May 13 16:23:43.979076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 34/63] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:43 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:44.066104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:44.067001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:44.078307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.079079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.080065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.080823 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.258124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:44.259132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:44.271546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.272162 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.273443 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.274020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.298830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:44.313722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cdc7934e-d3a0-434a-bca7-ff69832f1e69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1232 microversion: 2.1 time: 0.249900 May 13 16:23:44.316394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:44 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1232 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:44.651608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:44.661075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e6079026-83c1-45a3-8db6-1282c28ae622 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.407559 May 13 16:23:44.661665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:44 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:44.685220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:44.688291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:44.699178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.701236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.701236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:44.701568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:44.995151 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:44.996674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:45.016764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.017431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:45.018918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.018918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:45.183876 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:45.185554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:45.196753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-828f937f-55df-494b-8fa0-91d17deeda38 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.516309 May 13 16:23:45.204171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:44 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:45.217051 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bc879e22-98ba-4183-8902-bfb2f74ef14c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1217 microversion: 2.1 time: 0.225683 May 13 16:23:45.226548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:44 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:45.338174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:45.339441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:45.357513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.360563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:45.362079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.362796 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:45.530197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:45.552324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f017744a-2ade-4733-8116-52883d0c9abf tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1288 microversion: 2.1 time: 0.216724 May 13 16:23:45.568349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 32/68] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:45 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1288 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:45.686909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:45.689611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:45.695938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.696690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:45.697737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:45.698745 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.099908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:46.112545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-72e67c49-255b-458e-8e14-90983c6eb1ff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.429539 May 13 16:23:46.123689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 37/69] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:45 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:46.224407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:46.225333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:46.233392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.233957 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.235010 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.235554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.236181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:46.236752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:46.244335 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.244793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.245632 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.246258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.399239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:46.413771 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a0168ea3-4c49-4b8d-93d8-5c8c2ca608e5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1217 microversion: 2.1 time: 0.182105 May 13 16:23:46.420968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 38/70] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:46 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:46.547923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:46.562289 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d5d9cfc8-d228-4a22-a934-6d5737df2fd1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.341674 May 13 16:23:46.564373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 33/71] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:46 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:46.579725 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:46.581565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:46.591174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.591972 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.593755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:46.594353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:46.770912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:46.779595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6dd05170-621d-4221-8dd5-af94f5301677 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1294 microversion: 2.1 time: 0.204837 May 13 16:23:46.781284 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:46 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1294 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:47.129896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:47.130652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:47.138726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.139546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.140426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.140975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.450515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:47.451722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:47.496813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.510112 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.511565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.512040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.687943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:47.698793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9fa6e9b3-300c-41ab-acb5-f0c064806f9b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.572539 May 13 16:23:47.699964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 34/73] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:47 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:47.705125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:47.706033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:47.722570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.723121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.729335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.729335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.763232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:47.776482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-52f1308d-3ba0-4834-a654-c645b1fe419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1273 microversion: 2.1 time: 0.341839 May 13 16:23:47.786883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 40/74] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:47 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:47.799164 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:47.799851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:47.816757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.817802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:47.818863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:47.819347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:48.190037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:48.204039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-684bfc0c-8052-42de-8645-2959b5edc31e tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.502695 May 13 16:23:48.204640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 35/75] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:47 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:48.570481 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:48.585543 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d41ab885-27b7-4f7d-9b15-69dbaee8e9d8 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.791969 May 13 16:23:48.595994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:47 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:48.716786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:48.717565 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:48.726385 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:48.727089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:48.727908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:48.729048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:48.800425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:48.805510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:48.817741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:48.817741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:48.817741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:48.818251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:48.992885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:49.003955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0b568650-ba02-43a1-b8d8-bee2a6fab4f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1279 microversion: 2.1 time: 0.213504 May 13 16:23:49.006184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:48 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:49.222816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:49.222816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:49.235803 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:49.238984 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:49.240000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:49.240455 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:49.296792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:49.308566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fe4a78a2-0868-4d02-8f26-2c59fe633397 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.596449 May 13 16:23:49.309728 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 36/78] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:48 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:49.519613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-159f8828-ec86-4690-acc2-000e1584c52b req-d41d1225-14b2-411f-994d-31580a605c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a407d6-bb90-4453-84b9-c2974222a3c1", "tag": "9fff021c-19fd-4cb7-855b-b4a5179b6887"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:49.523976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:49.523976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:23:49.552108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-159f8828-ec86-4690-acc2-000e1584c52b req-d41d1225-14b2-411f-994d-31580a605c72 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:49.552664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-159f8828-ec86-4690-acc2-000e1584c52b req-d41d1225-14b2-411f-994d-31580a605c72 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:49.617490 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-159f8828-ec86-4690-acc2-000e1584c52b req-d41d1225-14b2-411f-994d-31580a605c72 service nova] Creating event network-changed:9fff021c-19fd-4cb7-855b-b4a5179b6887 for instance a6a407d6-bb90-4453-84b9-c2974222a3c1 on hv-cinder-68948 May 13 16:23:49.627911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-159f8828-ec86-4690-acc2-000e1584c52b req-d41d1225-14b2-411f-994d-31580a605c72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122468 May 13 16:23:49.629657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 37/79] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:49.656306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:49.658341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:49.679492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:49.680216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:49.682300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:49.682809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:49.735545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:49.755437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c80a205e-7216-46de-884b-eddf2f94f8e3 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.537301 May 13 16:23:49.757384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 43/80] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:49 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:50.022643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:50.023283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:50.037893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.038337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.040341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.045565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.237634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:50.239078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:50.251924 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a5934b89-1e41-492e-99fb-55b043411841 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.620833 May 13 16:23:50.252511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 38/81] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:49 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:50.262879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f5b84300-e208-4ad4-9a88-f31a174506ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1279 microversion: 2.1 time: 0.233369 May 13 16:23:50.262879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 44/82] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:50 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:50.332680 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:50.339522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:50.342914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.343493 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.348536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.348536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.571397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-33a73b25-b651-4178-9614-2eaf559d885a req-6c415579-8ffa-4d83-9823-f0fc62f8979f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c7c299-cc4b-4299-b6af-e0b4e21580e4", "tag": "91e8a7e6-b89b-4740-86a4-9c3ed6143aba"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:50.574381 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:50.574381 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:23:50.598064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-33a73b25-b651-4178-9614-2eaf559d885a req-6c415579-8ffa-4d83-9823-f0fc62f8979f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.598707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-33a73b25-b651-4178-9614-2eaf559d885a req-6c415579-8ffa-4d83-9823-f0fc62f8979f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.664243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-33a73b25-b651-4178-9614-2eaf559d885a req-6c415579-8ffa-4d83-9823-f0fc62f8979f service nova] Creating event network-changed:91e8a7e6-b89b-4740-86a4-9c3ed6143aba for instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 on hv-cinder-68948 May 13 16:23:50.684895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-33a73b25-b651-4178-9614-2eaf559d885a req-6c415579-8ffa-4d83-9823-f0fc62f8979f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117315 May 13 16:23:50.693515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 39/83] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:23:50.778066 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:50.778869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:50.802664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.803421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:50.810156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:50.810833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:51.223181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:51.234590 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:51.254746 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d0466081-685d-46f3-97a7-b174e5e7c94b tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.479106 May 13 16:23:51.268102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-45ad1fde-1a0e-41fa-8ac4-6320750ff9d6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.939383 May 13 16:23:51.268714 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 45/84] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:50 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:51.269528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 40/85] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:50 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:51.279372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:51.280366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:51.281295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:51.286324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:51.297731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:51.299367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:51.300244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:51.302039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:51.302186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:51.302886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:51.307954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:51.308777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:51.786687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:51.796509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a73b24ca-18a7-44e3-ab65-354322ecd0d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.525591 May 13 16:23:51.797633 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 41/86] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:51 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:52.277961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:52.277961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:52.287725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.288487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:52.289803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.290441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:52.400845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:52.430067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-61aedf75-a310-4cc8-8715-e020208ca0bd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 1.155460 May 13 16:23:52.430845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 46/87] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:51 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:52.437052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:52.438096 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:52.449198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.450169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:52.451242 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.452224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:52.781680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:52.791030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6ef82c58-ebce-4431-b1e6-f4a169a32d00 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.520072 May 13 16:23:52.791630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 42/88] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:52 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:52.814224 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:52.814870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:52.828395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.828945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:52.829909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:52.833411 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.129333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:53.150787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-05d7c049-40d1-4537-a977-61c47e4391d7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.339851 May 13 16:23:53.153140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:52 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:53.288589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:53.298885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e17cfadb-ab5e-4f68-9348-31bc6e3f3274 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.865941 May 13 16:23:53.300072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:52 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:53.453110 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:53.456145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:53.476930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.479250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.482222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.483178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.573558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-458fb644-9ac2-487d-8b3c-4cb3a26b93aa req-a91f6a58-653e-4040-841e-f82b91c9991e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddf1269-b8cb-46b2-ba2c-e02abc16df28", "tag": "9516730e-2cbf-4b11-9412-8451718c0ac6"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:53.575918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:53.575918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:23:53.601679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-458fb644-9ac2-487d-8b3c-4cb3a26b93aa req-a91f6a58-653e-4040-841e-f82b91c9991e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.602115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-458fb644-9ac2-487d-8b3c-4cb3a26b93aa req-a91f6a58-653e-4040-841e-f82b91c9991e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.634609 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-458fb644-9ac2-487d-8b3c-4cb3a26b93aa req-a91f6a58-653e-4040-841e-f82b91c9991e service nova] Creating event network-changed:9516730e-2cbf-4b11-9412-8451718c0ac6 for instance 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 on hv-cinder-68948 May 13 16:23:53.641456 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-458fb644-9ac2-487d-8b3c-4cb3a26b93aa req-a91f6a58-653e-4040-841e-f82b91c9991e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071706 May 13 16:23:53.643294 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 48/91] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:53.718844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-81cd2a50-5927-4102-9e77-5a024dde4ffa req-7c6f9c57-a6ae-4ca9-9273-234e44cbbe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b104ab9f-9762-479e-9288-0481bcd996b2", "name": "network-vif-plugged", "status": "completed", "tag": "42fb0d7b-d102-4bfa-8c00-e49ba8823bc8"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:53.720733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:53.720733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:23:53.748228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-81cd2a50-5927-4102-9e77-5a024dde4ffa req-7c6f9c57-a6ae-4ca9-9273-234e44cbbe07 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.765123 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-81cd2a50-5927-4102-9e77-5a024dde4ffa req-7c6f9c57-a6ae-4ca9-9273-234e44cbbe07 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.803483 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-81cd2a50-5927-4102-9e77-5a024dde4ffa req-7c6f9c57-a6ae-4ca9-9273-234e44cbbe07 service nova] Creating event network-vif-plugged:42fb0d7b-d102-4bfa-8c00-e49ba8823bc8 for instance b104ab9f-9762-479e-9288-0481bcd996b2 on hv-cinder-68948 May 13 16:23:53.816393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-81cd2a50-5927-4102-9e77-5a024dde4ffa req-7c6f9c57-a6ae-4ca9-9273-234e44cbbe07 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171793 May 13 16:23:53.817102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 49/92] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:53.825004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:53.825995 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:53.836066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.836783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.838093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:53.838688 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:53.840505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:53.849582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b30bb209-530c-4a2e-b1e4-a1f1d6d0a23c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.403452 May 13 16:23:53.850173 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 44/93] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:53 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:54.176074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:54.176782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:54.184851 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.186056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.186973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.187541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.241260 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:54.252750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ed4262a2-da0d-49ac-af6c-cebe1fef4b34 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.434062 May 13 16:23:54.253451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 50/94] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:53 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:54.316103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:54.316733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:54.334541 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.335000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.335802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.336244 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.491616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:54.505269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-72cd5461-4905-4d23-a3e4-3a262b8af5b2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.334281 May 13 16:23:54.506217 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 45/95] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:54 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:54.877253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:54.877904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:54.892612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.893421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.895097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:54.895779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:54.935564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:54.951990 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9773a514-14dc-4fe5-9466-10d614d19f65 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.639974 May 13 16:23:54.955074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 51/96] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:54 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:55.248028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:55.259429 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4f98d05b-24f6-46eb-9432-ed044606feee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.392067 May 13 16:23:55.270207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 46/97] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:54 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:55.271547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:55.272176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:55.299031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.302815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.304903 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.305385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.526176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:55.527505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:55.544800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.545638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.546933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.547582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.827714 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:55.839919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-02a86dce-f9ef-42b4-8b6b-02d8e77add95 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.572351 May 13 16:23:55.841396 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 52/98] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:55 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:55.856565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-8dd15976-ca24-4c31-bafa-2294656bbf1f req-c44587a4-4998-4bd3-92a0-395ea248d895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1f5404-fbcb-4bac-88f2-711e68d8e0c1", "name": "network-vif-plugged", "status": "completed", "tag": "6dbde7a2-50f1-49cf-b87e-608bd10930b3"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:55.858361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:55.860363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:55.860363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:23:55.868003 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4d42e001-bc29-4293-95f1-84f172e92efa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.346247 May 13 16:23:55.868962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:55 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:55.875892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-8dd15976-ca24-4c31-bafa-2294656bbf1f req-c44587a4-4998-4bd3-92a0-395ea248d895 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.877133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-8dd15976-ca24-4c31-bafa-2294656bbf1f req-c44587a4-4998-4bd3-92a0-395ea248d895 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.895394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-8dd15976-ca24-4c31-bafa-2294656bbf1f req-c44587a4-4998-4bd3-92a0-395ea248d895 service nova] Creating event network-vif-plugged:6dbde7a2-50f1-49cf-b87e-608bd10930b3 for instance 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 on hv-cinder-68948 May 13 16:23:55.901565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-8dd15976-ca24-4c31-bafa-2294656bbf1f req-c44587a4-4998-4bd3-92a0-395ea248d895 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049722 May 13 16:23:55.903674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 53/100] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:55.974125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:55.974791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:55.982347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.983080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:55.983882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:55.984325 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.207264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:56.216784 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bb393a06-049e-4cb1-a945-6375d9fb13d1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.248349 May 13 16:23:56.218114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 48/101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:55 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:56.277044 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:56.277553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:56.292939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.293611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.294409 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.294942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.574175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:56.584604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2fa5c8a0-405a-4279-b93c-0e3c4b52313d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.312202 May 13 16:23:56.594823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 54/102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:56 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:56.860878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:56.861548 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:56.873396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.874028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.875481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.875945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.886382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:56.887458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:56.897281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.898059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:56.899121 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:56.900392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:57.142018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:57.154922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c3342982-5302-4e51-a9ed-a048c9da2411 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.272960 May 13 16:23:57.156354 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 55/103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:56 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:57.191314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:57.200693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60c4f6f5-be01-4899-a14d-babc290b64f7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.346233 May 13 16:23:57.201459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 49/104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:56 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:57.234918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:57.235582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:57.242848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:57.243310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:57.244348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:57.245207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:57.456751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:57.467101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f5ef85b6-d6d9-4f29-a3a6-3e717ea737ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.236133 May 13 16:23:57.468194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 56/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:57 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:57.603769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:57.605212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:57.613668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:57.614124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:57.615261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:57.615712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:57.819824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:57.828698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1c6a5f17-d59e-4890-becb-6e3a77a75dc4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.231369 May 13 16:23:57.829200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 50/106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:57 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:58.172044 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:58.172654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:58.179801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.180250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.181586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.182028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.225415 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:58.227119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:58.236846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.238250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.239281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.239923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.510229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:58.519944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d41acb20-0426-41f8-a99c-f2d379b3fb2c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.351547 May 13 16:23:58.530392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 57/107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:58 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:58.535248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:58.535868 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:58.544378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.545276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.546531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.547397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.612325 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:58.625214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6350a5d3-c09e-42ff-b4a2-93f504259fc8 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1315 microversion: 2.1 time: 0.403405 May 13 16:23:58.636476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 51/108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:58 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:23:58.804994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:58.815184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9c5089c8-02e3-4737-954e-4f0828e8399a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1318 microversion: 2.1 time: 0.283482 May 13 16:23:58.819102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:58 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:58.844369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:58.844985 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:58.852176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.852635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:58.853482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:58.853973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.099565 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:59.113021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-813d196c-56da-4ecb-bbf1-484b7406dffe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.272227 May 13 16:23:59.114470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 52/110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:58 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:59.385957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-a5d8aaf1-f96e-4ca5-b616-5c4c0ed7f505 req-39ca468b-6a11-49c3-9c2f-ffdc52a299fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c7c299-cc4b-4299-b6af-e0b4e21580e4", "name": "network-vif-plugged", "status": "completed", "tag": "91e8a7e6-b89b-4740-86a4-9c3ed6143aba"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:23:59.387954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:23:59.387954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:23:59.399261 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-a5d8aaf1-f96e-4ca5-b616-5c4c0ed7f505 req-39ca468b-6a11-49c3-9c2f-ffdc52a299fd service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.399768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-a5d8aaf1-f96e-4ca5-b616-5c4c0ed7f505 req-39ca468b-6a11-49c3-9c2f-ffdc52a299fd service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.416136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-a5d8aaf1-f96e-4ca5-b616-5c4c0ed7f505 req-39ca468b-6a11-49c3-9c2f-ffdc52a299fd service nova] Creating event network-vif-plugged:91e8a7e6-b89b-4740-86a4-9c3ed6143aba for instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 on hv-cinder-68948 May 13 16:23:59.420914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-a5d8aaf1-f96e-4ca5-b616-5c4c0ed7f505 req-39ca468b-6a11-49c3-9c2f-ffdc52a299fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040109 May 13 16:23:59.421657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 59/111] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:23:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:23:59.538821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:59.540327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:59.547965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.548669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.549742 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.550400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.643757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:59.644383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:59.654184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.654829 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.655826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.656443 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.881554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:59.885801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:23:59.905627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9d11c4a8-74f5-4387-b236-5692bdb1b39c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.371062 May 13 16:23:59.906768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 53/112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:59 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:59.907655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-da1ba406-79ed-49f7-a792-83b330b0b966 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1503 microversion: 2.1 time: 0.268046 May 13 16:23:59.919953 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:23:59.920268 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 60/113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:59 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:23:59.921026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:23:59.930604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.930604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:23:59.930604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:23:59.930604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:00.137801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:00.138884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:00.152934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:00.154595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:00.156459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:00.156962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:00.272751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:00.281422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9766bfd1-2d28-410f-9bbb-a436093aefdd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1508 microversion: 2.1 time: 0.373363 May 13 16:24:00.282234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 54/114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:23:59 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:00.409640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:00.418357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e181b26f-d859-46be-b37b-b9216ebceae3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.290017 May 13 16:24:00.418937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 61/115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:00 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:00.922604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:00.923181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:00.934551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:00.934551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:00.935007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:00.935872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:01.278980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:01.288928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-75a60419-d629-4ed5-ab94-96aad83af532 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.370152 May 13 16:24:01.289619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 55/116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:00 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:01.441297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-24b803eb-2197-4512-a833-3c878f6b1bf9 req-e8afb247-c0eb-4c5d-8116-253d380d6455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a407d6-bb90-4453-84b9-c2974222a3c1", "name": "network-vif-plugged", "status": "completed", "tag": "9fff021c-19fd-4cb7-855b-b4a5179b6887"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:01.446180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:01.446180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:24:01.446568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:01.446568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:01.463848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:01.466281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:01.469030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:01.469030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:01.470357 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-24b803eb-2197-4512-a833-3c878f6b1bf9 req-e8afb247-c0eb-4c5d-8116-253d380d6455 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:01.470866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-24b803eb-2197-4512-a833-3c878f6b1bf9 req-e8afb247-c0eb-4c5d-8116-253d380d6455 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:01.519468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-24b803eb-2197-4512-a833-3c878f6b1bf9 req-e8afb247-c0eb-4c5d-8116-253d380d6455 service nova] Creating event network-vif-plugged:9fff021c-19fd-4cb7-855b-b4a5179b6887 for instance a6a407d6-bb90-4453-84b9-c2974222a3c1 on hv-cinder-68948 May 13 16:24:01.532020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-24b803eb-2197-4512-a833-3c878f6b1bf9 req-e8afb247-c0eb-4c5d-8116-253d380d6455 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094464 May 13 16:24:01.534685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 56/117] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:01.750514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:01.760380 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-088ffd65-585e-4403-bb5b-344cd47caf7c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.329118 May 13 16:24:01.761451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:01 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:02.310528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:02.311091 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28cdf871-7885-4bdd-bceb-a61124bce2d0"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:02.311244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:02.311983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:02.319430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.319595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.319889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.320036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.320738 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.320921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.321356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.321492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.560401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:02.568722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-45bbc0ff-2c56-43bf-a7f6-2e77889223ec tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.262528 May 13 16:24:02.578979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 57/119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:02 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:02.777919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:02.778544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:02.785870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.786330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.787118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:02.787561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:02.996579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:03.011383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-229f4f7d-b297-466d-b6ae-222dd6319525 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.237678 May 13 16:24:03.012606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 58/120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:02 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:03.546530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-843706ce-921f-4c10-be2c-4565102bbde8 req-59549136-6653-4e26-a013-45c85887711f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf1269-b8cb-46b2-ba2c-e02abc16df28", "name": "network-vif-plugged", "status": "completed", "tag": "9516730e-2cbf-4b11-9412-8451718c0ac6"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:03.548210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:03.548210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:24:03.558706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-843706ce-921f-4c10-be2c-4565102bbde8 req-59549136-6653-4e26-a013-45c85887711f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:03.559323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-843706ce-921f-4c10-be2c-4565102bbde8 req-59549136-6653-4e26-a013-45c85887711f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:03.577895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-843706ce-921f-4c10-be2c-4565102bbde8 req-59549136-6653-4e26-a013-45c85887711f service nova] Creating event network-vif-plugged:9516730e-2cbf-4b11-9412-8451718c0ac6 for instance 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 on hv-cinder-68948 May 13 16:24:03.583348 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-843706ce-921f-4c10-be2c-4565102bbde8 req-59549136-6653-4e26-a013-45c85887711f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040807 May 13 16:24:03.584562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 59/121] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:03.590410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:03.591114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:03.603663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:03.603663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:03.603663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:03.603663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:03.686960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-991c3a91-da50-4653-aef6-80b017aa4367 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "POST /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.379846 May 13 16:24:03.687952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 63/122] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:24:02 2021] POST /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2/os-volume_attachments => generated 194 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:03.836350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:03.847097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dccb9a86-9dde-4744-974e-282dd8672953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1362 microversion: 2.1 time: 0.261138 May 13 16:24:03.860055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:03 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:04.014625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:04.016141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:04.027398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.028340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:04.029564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.030202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:04.030604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:04.031485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:04.041181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.042048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:04.043090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.043603 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:04.286807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:04.298041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-77aaf1ee-8250-4306-a59d-df8f03a5a8ad tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.273916 May 13 16:24:04.299017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 61/124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:04 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:04.870466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:04.873314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:04.882299 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.882869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:04.883738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:04.884391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:05.125900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:05.135048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e1d7d37f-a10d-4f28-b3aa-7f93f7356e4b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1548 microversion: 2.1 time: 0.273211 May 13 16:24:05.135734 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 62/125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:04 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1548 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:05.157547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:05.158108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:05.165698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:05.166212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:05.169371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:05.170016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:05.325333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-16290528-d86a-4e94-a592-fa9f662fa20d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171728 May 13 16:24:05.325965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 63/126] 10.222.0.42 () {58 vars in 1275 bytes} [Thu May 13 16:24:05 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:24:05.330516 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:05.331131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:05.339159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:05.339645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:05.340434 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:05.340870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:05.564874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:05.574017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4b907823-381b-48d4-8a02-06a468e51a8d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1321 microversion: 2.1 time: 0.246898 May 13 16:24:05.574616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 64/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:05 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:05.814478 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7b30229c-8cd4-4e04-93ab-7691cb723fa5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.806712 May 13 16:24:05.815113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 64/128] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:24:04 2021] POST /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1/os-volume_attachments => generated 194 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:06.592278 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:06.593304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:06.606212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:06.606986 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:06.608273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:06.608909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.024197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:07.034828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-86e24cc3-612c-4024-885b-b90fc31fbfc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1514 microversion: 2.1 time: 0.447474 May 13 16:24:07.036284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 65/129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:06 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:07.060338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:07.061583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:07.072751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.077369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.077369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.077369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.143108 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'flavor' on Instance uuid 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:07.440960 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:07.441915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:07.453564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.454029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.455637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.456113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.625033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e445573c-5cf9-4192-afca-909e7e8c7233 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28/action" status: 200 len: 32 microversion: 2.1 time: 0.569698 May 13 16:24:07.626187 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 65/130] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:07 2021] POST /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28/action => generated 32 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:07.638746 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-32e770f5-b5e2-49fe-957a-7e2c7964ac49 req-385c5980-1048-4082-8231-11beb527c4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a407d6-bb90-4453-84b9-c2974222a3c1", "tag": "9fff021c-19fd-4cb7-855b-b4a5179b6887"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:07.642344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:07.642344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:24:07.667574 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-32e770f5-b5e2-49fe-957a-7e2c7964ac49 req-385c5980-1048-4082-8231-11beb527c4f9 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.668073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-32e770f5-b5e2-49fe-957a-7e2c7964ac49 req-385c5980-1048-4082-8231-11beb527c4f9 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.691971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-32e770f5-b5e2-49fe-957a-7e2c7964ac49 req-385c5980-1048-4082-8231-11beb527c4f9 service nova] Creating event network-changed:9fff021c-19fd-4cb7-855b-b4a5179b6887 for instance a6a407d6-bb90-4453-84b9-c2974222a3c1 on hv-cinder-68948 May 13 16:24:07.698275 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-32e770f5-b5e2-49fe-957a-7e2c7964ac49 req-385c5980-1048-4082-8231-11beb527c4f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070552 May 13 16:24:07.698941 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 66/131] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:07.707675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:07.708693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:07.717753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.718548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.719504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:07.720574 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:07.973850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:07.984253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-97520225-a141-4761-b52a-6cf687ad2c88 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.281704 May 13 16:24:07.994419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 67/132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:07 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:09.003210 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:09.007315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:09.019174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:09.019640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:09.020458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:09.020909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:09.270120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:09.280004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bc2841dc-b2bb-4974-b5de-9426bff325ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.282539 May 13 16:24:09.281708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 68/133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:08 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:10.297504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:10.298132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:10.305516 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:10.306423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:10.307419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:10.307927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:10.530305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:10.542464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f4354f83-80cf-4ad4-ac41-18e2ddc3f317 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.248156 May 13 16:24:10.543212 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:10 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:11.476997 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7c0519f5-5bd8-4bb7-986f-37c2643e5fe9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 4.038712 May 13 16:24:11.483105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 66/135] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:07 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 4046 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:11.562134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:11.563383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:11.583192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:11.583662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:11.584471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:11.586374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:12.253248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:12.264891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2cfceb65-1b84-42ba-956c-3b18d90a48f2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.708685 May 13 16:24:12.266076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 70/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:11 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:12.490330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:12.491833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:12.501264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:12.501890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:12.502829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:12.503337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:13.283328 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:13.284834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:13.293307 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:13.294988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:13.295129 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:13.295893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:13.575465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:13.585030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3183b39e-d154-44c8-b385-886e7c8b9f17 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.306326 May 13 16:24:13.585967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:13 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:14.602804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:14.603543 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:14.614125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:14.614682 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:14.615562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:14.616222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:14.862531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:14.871808 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0b62812d-1f20-4cd6-9849-a578aa8a854e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.273246 May 13 16:24:14.881282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 72/138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:14 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:15.648583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-96b8be1e-35fd-4bac-bd6f-c09b005edef3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 3.162441 May 13 16:24:15.653257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 67/139] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:12 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 3168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:15.889372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:15.891254 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:15.902140 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:15.902986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:15.904025 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:15.904683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:16.591123 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:16.599588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-43166d65-fce2-4d96-8620-bc8edd11bd0a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.714435 May 13 16:24:16.600282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 73/140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:15 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:16.660707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:16.661831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:16.670880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:16.671319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:16.672186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:16.672637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:16.904396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-75045de3-67ac-45e0-a365-118d50469472 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.247978 May 13 16:24:16.905201 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 68/141] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:16 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:17.617179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:17.623128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:17.626152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:17.626607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:17.627392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:17.627966 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:17.866468 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:17.880006 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-133696ff-f220-4b34-b421-88cb327e02c4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.266493 May 13 16:24:17.892501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 74/142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:17 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:17.916903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:17.919392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:17.936878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:17.937597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:17.938557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:17.939157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.129035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-30566d70-743b-4841-bfde-d62fa2108f20 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.216596 May 13 16:24:18.132219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 69/143] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:17 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:18.511267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:18.511905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:18.519455 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.520015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.520913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.521498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.585687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:24:18.899155 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:18.900349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:18.909342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.909856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.911141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.911579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.950702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e2669443-2ca2-430c-aad1-5d028363ff01 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 204 len: 0 microversion: 2.1 time: 0.443511 May 13 16:24:18.951732 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 75/144] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:24:18 2021] DELETE /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:24:18.960155 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:18.960868 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:18.969262 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.969978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:18.970776 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:18.971262 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:19.161373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:19.174458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c7167de3-826a-4a10-a6bf-a1abb8cf1cab tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.280384 May 13 16:24:19.176216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 70/145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:18 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:19.204170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:19.206245 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:19.216161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:19.217142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:19.218246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:19.218889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:19.321864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:19.332171 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-17f61e0b-c10e-401e-b194-ea0b6691d00a tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1555 microversion: 2.1 time: 0.376127 May 13 16:24:19.342280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 76/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:18 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:19.427470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-93fe1320-381d-4044-83d5-64562bb0e5f9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.233503 May 13 16:24:19.429128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 71/147] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:19 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:20.191420 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:20.192036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:20.200526 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.201019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.201851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.202297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.350335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:20.351343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:20.360668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.362566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.362566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.363122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.443221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:20.464232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f22d1fe6-0b5a-4fa1-a0b8-a463e59c8035 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.275531 May 13 16:24:20.465853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 77/148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:20 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:20.478915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:20.480218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:20.510101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.510928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.511895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:20.513976 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:20.787212 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c9510b1a-def9-46db-8b7e-142b389ab13b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.319507 May 13 16:24:20.787865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 78/149] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:20 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:20.972342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:20.980543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ff3de1a3-7e61-43cc-a26d-f26a20eb8db7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1555 microversion: 2.1 time: 0.634470 May 13 16:24:20.981243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 72/150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:20 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1555 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:21.486501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:21.487769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:21.500568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:21.501392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:21.502518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:21.503060 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:21.759680 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:21.772315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-47e77c6e-7c10-4377-a921-110a417da86b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.288936 May 13 16:24:21.779954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 79/151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:21 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:21.800456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:21.802234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:21.816384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:21.818568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:21.821834 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:21.822772 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:21.997883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:21.998662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:22.006943 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:22.007394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:22.008203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:22.009470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:22.022453 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3aa4658e-7946-4e99-8d7d-f1954423bec0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.226444 May 13 16:24:22.026343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 73/152] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:21 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:24:22.235583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:22.247221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6e500da0-e38c-42da-9641-82236d9e412d tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1555 microversion: 2.1 time: 0.252877 May 13 16:24:22.247957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:21 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:22.795125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:22.797636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:22.820366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:22.821640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:22.829152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:22.829764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.034158 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:23.035747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:23.049725 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:23.053452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.054637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:23.055350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.182282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:23.192068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f2a80623-603d-4926-ad58-71cbd5f8021c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.408035 May 13 16:24:23.193919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:22 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:23.267770 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:23.269023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:23.288814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:23.289417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.290456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:23.290917 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.531215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f37d5e81-9c72-4550-9cd0-2d5ab9cb2b95 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 14 microversion: 2.1 time: 0.500830 May 13 16:24:23.532707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 81/155] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:23 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 14 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 16:24:23.623521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:23.638858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cf33999e-ce74-4054-b14e-be46da16eb84 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1555 microversion: 2.1 time: 0.378305 May 13 16:24:23.640894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 75/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:23 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:23.966461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-4a7bcd07-fe2a-4a7b-bf26-7532c71553d1 req-d7a6bc7b-6407-48c0-9cef-fe5d17297302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b104ab9f-9762-479e-9288-0481bcd996b2", "name": "network-vif-deleted", "tag": "42fb0d7b-d102-4bfa-8c00-e49ba8823bc8"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:23.968115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:23.968115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:24:23.978752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4a7bcd07-fe2a-4a7b-bf26-7532c71553d1 req-d7a6bc7b-6407-48c0-9cef-fe5d17297302 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:23.979287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4a7bcd07-fe2a-4a7b-bf26-7532c71553d1 req-d7a6bc7b-6407-48c0-9cef-fe5d17297302 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:23.995709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-4a7bcd07-fe2a-4a7b-bf26-7532c71553d1 req-d7a6bc7b-6407-48c0-9cef-fe5d17297302 service nova] Creating event network-vif-deleted:42fb0d7b-d102-4bfa-8c00-e49ba8823bc8 for instance b104ab9f-9762-479e-9288-0481bcd996b2 on hv-cinder-68948 May 13 16:24:24.000678 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-4a7bcd07-fe2a-4a7b-bf26-7532c71553d1 req-d7a6bc7b-6407-48c0-9cef-fe5d17297302 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038934 May 13 16:24:24.001023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 82/157] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:24.222118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:24.222893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:24.235628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.235935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.237028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.237534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.440434 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:24.449291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7d028f57-6a78-417f-a9d2-ce5f77c94765 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.231100 May 13 16:24:24.449862 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:24 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:24.544595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:24.546324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:24.554715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.555581 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.556840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.557616 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.657409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:24.658021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:24.666046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.666505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.667312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:24.667752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:24.743361 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4a5daab2-e571-4f2c-9b76-7af44995ddb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 2582 microversion: 2.1 time: 0.202095 May 13 16:24:24.745061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 83/159] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:24 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 2582 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:24.808041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:24.816817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4a6984a9-c0d2-4fc1-9a22-be89f7f1ceda tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1346 microversion: 2.1 time: 0.163238 May 13 16:24:24.817422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 77/160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:24 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:25.468015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:25.469006 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:25.484799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.484799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.484799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.484799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.757485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:25.772938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-330463db-b5c8-49e7-b9ce-f577e6ee49f1 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.303381 May 13 16:24:25.772938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 84/161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:25 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:25.773222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:25.773222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:25.779330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.780140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.781123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.781668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.834020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:25.834677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:25.843109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.843426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.844229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.845619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.925540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:25.925997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:25.926454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lazy-loading 'fault' on Instance uuid b104ab9f-9762-479e-9288-0481bcd996b2 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:25.970717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a8b83379-bc3d-43ce-94a4-7c8abf3b825f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 6451 microversion: 2.1 time: 0.220382 May 13 16:24:25.972935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 78/162] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:25 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 6451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:26.056890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:26.066776 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-388e2ab7-4754-4ed1-b21b-5453d28b3161 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1351 microversion: 2.1 time: 0.236337 May 13 16:24:26.067721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 85/163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:25 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:26.788346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:26.789052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:26.797152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:26.797615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:26.798402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:26.798843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:26.987418 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:26.989170 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:26.997851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:26.998303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:26.999156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:26.999603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:27.003551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:27.013994 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-22573a76-eac7-4a36-95d1-ab3c13db3d2b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.229673 May 13 16:24:27.014954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:26 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:27.088719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:27.089369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:27.096527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:27.096976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:27.097777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:27.098214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:27.166880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:27.167344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:27.167820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lazy-loading 'fault' on Instance uuid b104ab9f-9762-479e-9288-0481bcd996b2 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:27.225097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:27.233952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-aa343839-32c0-402a-8cb5-d5d9ddac46a7 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1351 microversion: 2.1 time: 0.148863 May 13 16:24:27.234521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 80/165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:27 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:28.030921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:28.031701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:28.039347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:28.039808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:28.040611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:28.041139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:28.241290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:28.250449 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-aaa69a35-26eb-4b47-a930-48323d3344f9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.223223 May 13 16:24:28.251055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:28 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:28.255735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:28.256359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:28.264304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:28.264769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:28.265593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:28.266044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:28.333491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:28.333947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:28.334402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lazy-loading 'fault' on Instance uuid b104ab9f-9762-479e-9288-0481bcd996b2 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:28.390622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:28.400081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1c856a28-d7da-46fa-a731-80aba3987b18 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1351 microversion: 2.1 time: 0.147960 May 13 16:24:28.400692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 82/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:28 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:29.267967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:29.268624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:29.276766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:29.277261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:29.282339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:29.282339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:29.494297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:29.502738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8b47e580-0655-4eda-b841-f54615da4097 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.238644 May 13 16:24:29.503517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 83/168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:29 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:29.508561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:29.509416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:29.517408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:29.517869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:29.518667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:29.519123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:29.593715 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:29.594173 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:29.594630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lazy-loading 'fault' on Instance uuid b104ab9f-9762-479e-9288-0481bcd996b2 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:29.654689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-05a5f62b-d65e-4c67-bfd4-af15334fd138 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 13887 microversion: 2.1 time: 2.665345 May 13 16:24:29.654689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 86/169] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:26 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 13887 bytes in 2668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:29.655252 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de8697706fb49229bedfe9dbe29950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600688833b844a9be98f7c1d64ba378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:29.660649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2f6b9464-a29b-42d1-ab92-4050eef657d1 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 200 len: 1351 microversion: 2.1 time: 0.155889 May 13 16:24:29.661252 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 84/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:29 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 1351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:30.112610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2013744169", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "364f9ea7-bb68-4d81-80ce-70cec45c9d8c"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:30.188700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] validate_networks() for [('364f9ea7-bb68-4d81-80ce-70cec45c9d8c', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:24:30.519653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:30.520834 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:30.537635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.538092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.539649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.540144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.734315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:24:30.735277 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:24:30.735798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:24:30.736245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:24:30.736673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:24:30.746076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.750674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.750674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.750674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.769385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:24:30.774551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for user 4884755f5b1a48cb8e5ff82429a30a31 and project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:24:30.777322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:30.785867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:24:30.786105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-61cef1b2-62f0-413d-83e9-6dcc92473c30 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.270121 May 13 16:24:30.786690 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 85/171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:30 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:30.790863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:24:30.792017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:30.793141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:30.800770 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.801507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.802538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.803151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.885197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-266b4518-859e-44a2-9953-446593b5ed41 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776770 May 13 16:24:30.886306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 87/172] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:24:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:24:30.891752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:30.892385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:30.902296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.902804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.903783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:30.904224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:30.958453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] HTTP exception thrown: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. May 13 16:24:30.959244 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Returning 404 to user: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:24:30.960236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ce368132-fbdb-4869-bfd9-6cc24cbee396 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 404 len: 111 microversion: 2.1 time: 0.072828 May 13 16:24:30.961850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 88/173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:30 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:24:30.968124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-78f5580e-e105-449f-ab54-bc6deaf96e03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:30.968809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-78f5580e-e105-449f-ab54-bc6deaf96e03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:30.969165 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1ec0c395-8a63-4d1f-99a2-d41c8c0ba688 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 16450 microversion: 2.1 time: 0.180823 May 13 16:24:30.973425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 86/174] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:30 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 16450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:31.131709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-78f5580e-e105-449f-ab54-bc6deaf96e03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:31.140401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-78f5580e-e105-449f-ab54-bc6deaf96e03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1218 microversion: 2.1 time: 0.177363 May 13 16:24:31.140961 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 89/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:30 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:31.737212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-712975531", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "6b26855a-a663-49c7-acbe-02b43c2541a7"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:31.806580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:31.807202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:31.816375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:31.817160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] validate_networks() for [('6b26855a-a663-49c7-acbe-02b43c2541a7', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:24:31.817575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:31.818531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:31.819111 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.045363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:32.055712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-902b7f1b-a5e3-413a-8328-83ad1e523ab2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.253385 May 13 16:24:32.057687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:31 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:32.067687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:32.067687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:32.070838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.071295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.072098 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.072546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.399882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:24:32.400306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:24:32.400783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:24:32.401233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:24:32.401649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:24:32.410116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.410563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.411370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.411843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.430131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Getting quotas for project 962a3c5540a24061b68fd96894c59c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:24:32.434099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Getting quotas for user b5adf0abb48b42aaba79305dd79c21ce and project 962a3c5540a24061b68fd96894c59c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:24:32.444537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:24:32.447389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:24:32.593024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ccc743ea-3006-49b4-b98f-3a1ec270fb7e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859997 May 13 16:24:32.593832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 87/177] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:24:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:24:32.598404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:32.599131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:32.607682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.608221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.609153 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:32.609697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:32.728386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:32.736800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b1db9991-e9c6-4a42-9797-9a89e2eea73c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1214 microversion: 2.1 time: 0.141905 May 13 16:24:32.737396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 88/178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:32 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:32.741773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-38b03c37-29d0-4edf-a07c-dd798bc51b96 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:32.742435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-38b03c37-29d0-4edf-a07c-dd798bc51b96 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:32.811976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-38b03c37-29d0-4edf-a07c-dd798bc51b96 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:32.819428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-38b03c37-29d0-4edf-a07c-dd798bc51b96 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1218 microversion: 2.1 time: 0.081067 May 13 16:24:32.820096 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 89/179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:32 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:33.074336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:33.074959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:33.082922 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.083427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:33.084221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.084668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:33.290060 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:33.298555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-50229bb5-9399-43a4-9039-51e37846f3a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.228535 May 13 16:24:33.299408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 90/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:33 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:33.753818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:33.754432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:33.761766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.762219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:33.763004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.763444 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:33.873390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:33.881506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f2cf4dd0-1046-436e-ac06-7ccfdff391b7 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1214 microversion: 2.1 time: 0.131283 May 13 16:24:33.882073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 91/181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:33 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:33.886378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:33.886986 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:33.893984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.894442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:33.895273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:33.895662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:34.006595 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:34.015244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-09f73d8d-c0fc-4065-a5ad-b777c1052f37 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1222 microversion: 2.1 time: 0.132208 May 13 16:24:34.015810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 92/182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:33 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:34.321545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:34.322205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:34.329645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:34.334374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:34.334374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:34.334374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:34.533794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:34.542877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-773b2226-dc77-41fc-beba-8312b746393c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.225602 May 13 16:24:34.545105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 93/183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:34 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:34.897488 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:34.898511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:34.905811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:34.906268 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:34.907085 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:34.907530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:35.016700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:35.024865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0db82f4f-39fa-4520-bf12-41100fe39716 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1214 microversion: 2.1 time: 0.131155 May 13 16:24:35.025488 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 94/184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:34 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:35.031413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:35.032106 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:35.040229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:35.040684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:35.041499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:35.041939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:35.153856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-db32d2db-6cc8-4c86-aeaa-1bf631f356f2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 21890 microversion: 2.1 time: 3.094694 May 13 16:24:35.154863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 91/185] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:32 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 21890 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:35.162300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:35.171472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-11248f6d-d982-4c52-9715-3ca2d86ad6e6 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1222 microversion: 2.1 time: 0.143716 May 13 16:24:35.172048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 95/186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:35 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:35.560603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:35.561351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:35.569987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:35.575832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:35.575832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:35.575832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:35.780623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:35.790378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0278baf2-b096-4166-81ea-1f2d761dab04 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.234040 May 13 16:24:35.790969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 92/187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:35 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:36.042414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:36.043028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.050311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.050852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.051647 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.052068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.166093 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:36.167054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:36.167987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.174684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1551ec24-4c60-4b04-8c99-864d251a06a5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1270 microversion: 2.1 time: 0.136814 May 13 16:24:36.175257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 96/188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:36 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:36.175378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.175739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.184487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.185618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.188027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:36.188727 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.197426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.198170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.199414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.199935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.330806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:36.342563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8e0b6ab5-bd7e-4fa8-ad76-1717c12d047d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1270 microversion: 2.1 time: 0.158181 May 13 16:24:36.351950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 97/189] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:36 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:36.362485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c427c953-70e6-491c-9669-339ce6d19867 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 22982 microversion: 2.1 time: 0.200621 May 13 16:24:36.363132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 93/190] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:36 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 22982 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:24:36.467112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:36.467623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.475500 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.475963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.476760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.477237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.534525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] HTTP exception thrown: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. May 13 16:24:36.535196 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Returning 404 to user: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:24:36.536048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d3e8c5a5-dbac-4fda-9ca9-453c163d4458 tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 404 len: 111 microversion: 2.1 time: 0.072761 May 13 16:24:36.537074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 98/191] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:24:36 2021] DELETE /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:24:36.546028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:36.546802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] [instance: b104ab9f-9762-479e-9288-0481bcd996b2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.557785 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.558706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.559777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.560332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.618003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] HTTP exception thrown: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. May 13 16:24:36.618641 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] Returning 404 to user: Instance b104ab9f-9762-479e-9288-0481bcd996b2 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:24:36.619437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f4405d8a-1262-40b9-ab8f-bd6571ec19eb tempest-DeleteServersTestJSON-1654658389 tempest-DeleteServersTestJSON-1654658389-project] 10.222.0.42 "GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2" status: 404 len: 111 microversion: 2.1 time: 0.078197 May 13 16:24:36.620146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 94/192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:36 2021] GET /compute/v2.1/servers/b104ab9f-9762-479e-9288-0481bcd996b2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:24:36.807226 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:36.807860 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:36.815223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.815770 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:36.816780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:36.817242 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.040117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:37.048940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-43109013-ba90-4d8f-a23f-aefe74c0412c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.246330 May 13 16:24:37.059494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 99/193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:36 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:37.191229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:37.191748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:37.199379 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.199838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.200623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.201201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.360892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:37.361207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:37.371879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:37.372189 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7f962d1b-dfee-44db-8980-545f7bbfe24f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1276 microversion: 2.1 time: 0.184734 May 13 16:24:37.372751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 95/194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:37 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:37.378331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:37.378331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:37.382934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.383513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.384477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.385053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.388126 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.388583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.389408 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:37.389849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:37.514234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:37.523119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c8940ddf-0ac0-43ac-be1a-6c3bc67fcf34 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1278 microversion: 2.1 time: 0.166857 May 13 16:24:37.524426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:37 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:38.066552 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:38.067220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:38.074782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.075244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.076026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.076464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.301887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:38.310744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-879224e0-2b62-43b8-a09e-8b59345b937d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.248181 May 13 16:24:38.311314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 101/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:38 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:38.394875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:38.395661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:38.404130 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.404832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.405818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.409042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.610844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:38.619617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b36752af-c1aa-410a-918e-99fc22c9a21f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.229714 May 13 16:24:38.620179 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:38 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:38.627473 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:38.631279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:38.635353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.635815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.636602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:38.637043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:38.764151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:38.772175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d84e1cea-acae-4e74-8f23-6a31f8578fe1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1278 microversion: 2.1 time: 0.148206 May 13 16:24:38.772752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:38 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:39.327679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:39.328328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:39.335761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:39.336356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:39.337887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:39.338327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:39.567993 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:39.576464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7fd9ea2-4366-4e64-9d7d-62cacad5466d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.252432 May 13 16:24:39.585671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 104/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:39 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:39.635359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:39.637758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:39.643630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:39.644090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:39.645074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:39.645541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:40.212425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:40.212425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-40a5994e-7f9a-419b-b006-7b040bb2076d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.221967 May 13 16:24:40.212425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:39 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:40.212425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:40.213788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:40.213788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:40.213788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:40.213788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:40.214418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:40.214418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:40.214418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dcf18afd-7bdc-425e-b254-4fd97340f9e1 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1278 microversion: 2.1 time: 0.133854 May 13 16:24:40.214418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 106/201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:39 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:40.231057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bbf57230-520a-41e9-b7c1-4d4cae0e615f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 25082 microversion: 2.1 time: 2.856974 May 13 16:24:40.239940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 96/202] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:37 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 25082 bytes in 2859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:40.595654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:40.595654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:40.609787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:40.610353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:40.612580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:40.613056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:40.860982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:40.874072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1aa4e652-088e-401a-a5a2-2ec6a163433e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.284432 May 13 16:24:40.875709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 107/203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:40 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:41.211568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:41.211568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:41.214345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:41.215115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:41.223674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.224069 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.224915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.225441 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.225542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.226158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.226877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.227389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.478325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:41.489413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-59e28c32-8731-4e4f-9b9f-9b49e85b1853 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1276 microversion: 2.1 time: 0.287891 May 13 16:24:41.490108 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 97/204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:41 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:41.496497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:41.515603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:41.519644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.520178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.521120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.521783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.532170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:41.547070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-49e9522e-f37f-4c5d-9823-212ef5b7c4b9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.342677 May 13 16:24:41.550171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 108/205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:41 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:41.711723 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fc0849da-ce0f-4fd7-a299-4247b195d15b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 25942 microversion: 2.1 time: 0.220021 May 13 16:24:41.715559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 98/206] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:41 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 25942 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:41.891775 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:41.894621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:41.910329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.910897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.911687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.912399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:41.934962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-367638a6-f7bc-45cb-8732-bc1b1e40f484 req-cedf5499-073f-4242-8667-a2aa2193873d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5776983-7618-42a1-a71f-f0ed5336525f", "tag": "d48752e7-15bf-45ed-b9fc-25fe3dece5b5"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:41.936491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:41.936491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:24:41.955367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-367638a6-f7bc-45cb-8732-bc1b1e40f484 req-cedf5499-073f-4242-8667-a2aa2193873d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:41.956078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-367638a6-f7bc-45cb-8732-bc1b1e40f484 req-cedf5499-073f-4242-8667-a2aa2193873d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.004280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-367638a6-f7bc-45cb-8732-bc1b1e40f484 req-cedf5499-073f-4242-8667-a2aa2193873d service nova] Creating event network-changed:d48752e7-15bf-45ed-b9fc-25fe3dece5b5 for instance c5776983-7618-42a1-a71f-f0ed5336525f on hv-cinder-68948 May 13 16:24:42.017583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-367638a6-f7bc-45cb-8732-bc1b1e40f484 req-cedf5499-073f-4242-8667-a2aa2193873d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085963 May 13 16:24:42.017583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 99/207] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:42.242117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:42.251235 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3b465ac1-3325-4407-964e-69f4e0232c0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.363053 May 13 16:24:42.252068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 109/208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:41 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:42.508060 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:42.509477 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:42.517206 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.517952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.518972 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.519758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.566671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:42.567295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:42.584388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.587108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.589307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.589787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.858493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:42.879967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e7e524cb-f017-4573-a766-5838e81f713e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.312166 May 13 16:24:42.880950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 110/209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:42 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:42.892939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:42.896528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:42.915150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.916972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:42.918043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:42.918710 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:43.097472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-052a8649-5791-4230-84f5-840780270988 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 26731 microversion: 2.1 time: 0.214765 May 13 16:24:43.100905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 111/210] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:42 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 26731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:43.269007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:43.270228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:43.281795 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:43.282623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:43.283717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:43.284370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:43.599763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:43.610297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f8f83919-0998-4d7c-942e-97d9b00d63b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 1.106315 May 13 16:24:43.611465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 100/211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:42 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:43.808949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:43.823939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1247cd4e-cb66-4cb5-bdeb-6277dcced2a5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.559512 May 13 16:24:43.824579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:43 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:43.900343 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:43.902185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:43.920311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:43.920767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:43.921743 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:43.922190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.111397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:44.113499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:44.134625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:44.134625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.134625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:44.134625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.348447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-52a44441-3f99-408d-b61c-21616d70c564 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 27154 microversion: 2.1 time: 0.242933 May 13 16:24:44.349153 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 113/213] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:44 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 27154 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:44.552812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-a79e597b-1dba-4b04-9346-2a01db74f20d req-97f47a8a-653b-4920-842d-e68fa8ab4b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c53c86b7-07d6-450d-8987-4ecaabb80bd2", "tag": "1533ac6c-95eb-4a37-b138-4afe4d1ecc03"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:44.555881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:44.555881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:24:44.570720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-a79e597b-1dba-4b04-9346-2a01db74f20d req-97f47a8a-653b-4920-842d-e68fa8ab4b4e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:44.572027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-a79e597b-1dba-4b04-9346-2a01db74f20d req-97f47a8a-653b-4920-842d-e68fa8ab4b4e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.613493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-a79e597b-1dba-4b04-9346-2a01db74f20d req-97f47a8a-653b-4920-842d-e68fa8ab4b4e service nova] Creating event network-changed:1533ac6c-95eb-4a37-b138-4afe4d1ecc03 for instance c53c86b7-07d6-450d-8987-4ecaabb80bd2 on hv-cinder-68948 May 13 16:24:44.620867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-a79e597b-1dba-4b04-9346-2a01db74f20d req-97f47a8a-653b-4920-842d-e68fa8ab4b4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074065 May 13 16:24:44.622414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 114/214] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:24:44.643530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:44.644287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:44.653171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:44.653641 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.654451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:44.654902 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:44.934815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:44.965059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f7c87285-15dd-4980-9111-aed1b94d7fd6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 1.070100 May 13 16:24:44.965684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 101/215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:43 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:44.977437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:44.982202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:45.005036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:45.006045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:45.010800 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:45.010800 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:45.084202 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:45.093573 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-05d976da-2b4e-4b25-80d5-db2034e15de9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.469519 May 13 16:24:45.103246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 115/216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:44 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:45.360424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:45.362296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:45.378025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:45.378482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:45.379281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:45.381672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:45.619510 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2a3dae9b-cd57-4a65-8f95-08c75b3f6932 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 27416 microversion: 2.1 time: 0.262228 May 13 16:24:45.621000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 116/217] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:45 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 27416 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:24:45.716955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:45.734780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8907ebe0-fc34-4018-98fa-e91e9b53404a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.767845 May 13 16:24:45.735421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 102/218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:44 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:45.983940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:45.984658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:45.999359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.008933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.010708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.011319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.112933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:46.114798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:46.127057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.128054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.129015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.129684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.411050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:46.427323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e3d24d8d-6f02-4b13-a197-f040ebc9e135 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.319580 May 13 16:24:46.438315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 103/219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:46 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:46.470838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:46.480139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-936192e9-de3d-4eb9-acc2-bbb8837a07a0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.501584 May 13 16:24:46.480729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 117/220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:45 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:46.635925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:46.637460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:46.653978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.654883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.659934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.661837 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.756933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:46.756933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:46.767257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.767997 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.768982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:46.769662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:46.877577 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d630e478-cf7d-4de2-86a5-83b3e4e17558 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 27589 microversion: 2.1 time: 0.247066 May 13 16:24:46.881711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 104/221] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:46 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 27589 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:47.273226 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:47.286738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0415fce3-69c4-4fa0-8f75-bf34f1649e05 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.538536 May 13 16:24:47.301435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 118/222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:46 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:47.452018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:47.453028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:47.472190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.472684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:47.474469 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.474873 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:47.499816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:47.501358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:47.518274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.518436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:47.521768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.522237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:47.869710 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:47.882147 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-612a21d0-2a8e-4ecb-a75e-c6feee48e626 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.388314 May 13 16:24:47.892203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 119/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:47 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:47.902297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:47.903494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:47.911714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.912413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:47.913789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:47.914577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:48.105364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f72ce041-db68-4d2e-a8b3-0512042bf8a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 27789 microversion: 2.1 time: 0.204011 May 13 16:24:48.106550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 120/224] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:47 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 27789 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:48.307508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:48.308519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:48.320257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:48.320992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:48.321899 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:48.322482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:48.392699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:48.409364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f13e10b7-3dcc-43ba-8477-9c48d44d589d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.962853 May 13 16:24:48.419239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 105/225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:47 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:48.606857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:48.615812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3c882392-8879-40ad-80f4-045a8a9f2ed5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.315010 May 13 16:24:48.627550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 121/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:48 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:48.903232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:48.904355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:48.913004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:48.913004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:48.914011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:48.914602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.120713 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:49.122272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:49.132217 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.132674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.133988 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.134427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.277866 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:49.287745 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-efc9688c-33dc-4297-99bb-b622ee946a11 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.388438 May 13 16:24:49.288558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 106/227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:48 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:49.427251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:49.427801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:49.438403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.438867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.439663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.440107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.761662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:49.775884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ddefb813-794f-43b7-9044-5349f480ad8a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.352713 May 13 16:24:49.787150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 107/228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:49 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:49.794146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:49.794970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:49.804749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.805482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:49.807306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:49.807760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:50.224374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:50.237184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e894d8f1-f07a-466c-88c9-17c1750af903 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.448471 May 13 16:24:50.238473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 108/229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:49 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:50.311465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:50.312116 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:50.320139 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:50.320588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:50.321450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:50.321889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:50.824391 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:50.833334 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f7600c07-bbc0-453d-9c17-3abd60b24657 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.525463 May 13 16:24:50.834393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 109/230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:50 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:50.839863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:50.840559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:50.849540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:50.850085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:50.850957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:50.851462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:51.125048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-689ccc59-97ac-4260-accd-18b888f9e050 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 27916 microversion: 2.1 time: 2.009160 May 13 16:24:51.126280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 122/231] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:49 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 27916 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:24:51.256298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:51.257471 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:51.271830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:51.272668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:51.273940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:51.274724 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:51.296400 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:51.306130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7fd60a9e-3bc7-417b-9afe-6078b922f29b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.470404 May 13 16:24:51.307293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 110/232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:50 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:51.528070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:51.548409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-634d274f-841e-4a68-99f0-032d4bbb7c6c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.296855 May 13 16:24:51.559938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 123/233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:51 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:51.706398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: .version_select at 0x7ffa8c865820>, body: {"keypair": {"name": "tempest-keypair-1358001313"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:51.735278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:24:51.739464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:24:51.851913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:51.852854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:51.863976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:51.865305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:51.868188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:51.870353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.195525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:52.212348 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-45bf532f-f47a-49d9-8c48-8462408d459d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.361480 May 13 16:24:52.216457 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 124/234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:51 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:52.226339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:52.227300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:52.243328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.246762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.248541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.249300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.385906 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:24:52.390676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:24:52.407579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2b1adacd-3b9f-45c9-9a95-a3a3bc1812b1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.020681 May 13 16:24:52.413417 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 111/235] 10.222.0.42 () {62 vars in 1199 bytes} [Thu May 13 16:24:51 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1022 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 13 16:24:52.424100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:52.425807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:52.446767 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de22fd9a-6ab6-4cf8-8d40-586b5dccd2b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28150 microversion: 2.1 time: 0.228091 May 13 16:24:52.448615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 125/236] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:52 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28150 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:52.449855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.450376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.451245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.451831 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.567097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:52.567809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:52.576048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.576830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.577377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:52.577816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:52.713311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:52.725435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3e3a11ac-1675-45c4-8bb0-c3dcf32c2888 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.313668 May 13 16:24:52.736790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 112/237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:52 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:52.907207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:52.913750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a2ec3694-2d15-4ed3-851b-26c727059196 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.351508 May 13 16:24:52.914331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 126/238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:52 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:53.235194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:53.235986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:53.257317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.258800 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.262147 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.263140 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.460715 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:53.461963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:53.472450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.473231 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.474656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.475247 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.589794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:53.598970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fb1d54bc-06b9-45aa-bd9e-4ea77abe55ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.369333 May 13 16:24:53.599917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 113/239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:53 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:53.720303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1f3cc0ba-ce53-4eed-947d-210fdf74f8ad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28150 microversion: 2.1 time: 0.264730 May 13 16:24:53.722158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 127/240] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:53 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28150 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:53.741613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:53.743644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:53.750661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.751120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.751914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.752371 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.932783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:53.933553 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:53.941413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.942090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.943045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:53.943754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:53.973751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:53.996870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0fc1eb72-e3b7-4ee8-82b6-40cc1f21704f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.259989 May 13 16:24:54.010648 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 114/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:53 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:54.272207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:54.282237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-15292126-30e8-4b30-824d-43873b37c02a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.354493 May 13 16:24:54.283284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 128/242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:53 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:54.359426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-76646346-d2e2-4b5a-bbc0-562902a503d1 req-b2af2378-1dd5-4608-9389-eeb38a1859aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5776983-7618-42a1-a71f-f0ed5336525f", "name": "network-vif-plugged", "status": "completed", "tag": "d48752e7-15bf-45ed-b9fc-25fe3dece5b5"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:54.362626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:54.362626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:24:54.376537 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-76646346-d2e2-4b5a-bbc0-562902a503d1 req-b2af2378-1dd5-4608-9389-eeb38a1859aa service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:54.377048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-76646346-d2e2-4b5a-bbc0-562902a503d1 req-b2af2378-1dd5-4608-9389-eeb38a1859aa service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:54.403504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-76646346-d2e2-4b5a-bbc0-562902a503d1 req-b2af2378-1dd5-4608-9389-eeb38a1859aa service nova] Creating event network-vif-plugged:d48752e7-15bf-45ed-b9fc-25fe3dece5b5 for instance c5776983-7618-42a1-a71f-f0ed5336525f on hv-cinder-68948 May 13 16:24:54.412240 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-76646346-d2e2-4b5a-bbc0-562902a503d1 req-b2af2378-1dd5-4608-9389-eeb38a1859aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062576 May 13 16:24:54.413846 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 115/243] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:54.617660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:54.618448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:54.626588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:54.627104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:54.628389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:54.628523 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:54.736137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:54.738592 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:54.749340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:54.750406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:54.751359 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:54.751953 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:54.955292 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-34cf0848-e478-427b-a405-fda416b5567d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28165 microversion: 2.1 time: 0.226460 May 13 16:24:54.959662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 116/244] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:54 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28165 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:24:55.019763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:55.020186 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:55.037109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.037737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:55.038964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.039426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:55.075275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:55.112878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a6cb7c96-5bc2-4fac-9a2b-35e08f9c970f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.500239 May 13 16:24:55.113494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 129/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:54 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:55.300101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:55.300736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:55.310102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.314046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:55.318491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.319266 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:55.333366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:55.349292 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4e117013-2731-4e78-8fe8-026649854a17 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.335091 May 13 16:24:55.350689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 117/246] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:55 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:55.700922 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:55.713129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dee1bde5-1a21-4610-8bd6-224f01949a3d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.416501 May 13 16:24:55.714372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 130/247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:55 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:55.968276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:55.970458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:55.980707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.983016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:55.983016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:55.983391 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.130092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:56.130951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:56.145893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.146992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.147713 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.151416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.197646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d7f5c9fd-9661-41ba-84dd-27d5b705f467 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28440 microversion: 2.1 time: 0.232836 May 13 16:24:56.201759 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 118/248] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:55 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28440 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:56.368015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:56.382422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:56.383555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.388598 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.389495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.390104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.533442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:56.542790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cecabc66-0e7f-4fac-b72a-ee5c6bd20e27 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1318 microversion: 2.1 time: 0.416378 May 13 16:24:56.544086 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 131/249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:56 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:56.667723 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:56.677366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f336f706-35d5-473f-bae0-f53821535cb4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.313554 May 13 16:24:56.677952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 119/250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:56 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:56.731445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:56.732408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:56.740891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.749276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.749276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:56.749276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:56.754620 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2031585627", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed25e872-ac34-48bf-a01b-d439614d260b"}], "security_groups": [{"name": "tempest-securitygroup--34953167"}], "key_name": "tempest-keypair-1358001313", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:56.909542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] validate_networks() for [('ed25e872-ac34-48bf-a01b-d439614d260b', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:24:56.994321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:57.003372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a225c406-0d9a-4901-8420-0fd04b02d4b0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.276607 May 13 16:24:57.003950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 132/251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:56 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:57.210984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:57.212339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:57.222448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.227312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.227312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.227312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.500095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3405cff2-5876-445a-9590-3346d30de53f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28440 microversion: 2.1 time: 0.293504 May 13 16:24:57.500877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 133/252] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:57 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28440 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:24:57.506264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-5d72175f-1734-4ab6-8cb4-b296de1e932d req-44ba51b5-1470-4706-a4f1-733c48ae3703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53c86b7-07d6-450d-8987-4ecaabb80bd2", "name": "network-vif-plugged", "status": "completed", "tag": "1533ac6c-95eb-4a37-b138-4afe4d1ecc03"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:57.511184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:24:57.511184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:24:57.533929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-5d72175f-1734-4ab6-8cb4-b296de1e932d req-44ba51b5-1470-4706-a4f1-733c48ae3703 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.535791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-5d72175f-1734-4ab6-8cb4-b296de1e932d req-44ba51b5-1470-4706-a4f1-733c48ae3703 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.571580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-5d72175f-1734-4ab6-8cb4-b296de1e932d req-44ba51b5-1470-4706-a4f1-733c48ae3703 service nova] Creating event network-vif-plugged:1533ac6c-95eb-4a37-b138-4afe4d1ecc03 for instance c53c86b7-07d6-450d-8987-4ecaabb80bd2 on hv-cinder-68948 May 13 16:24:57.585390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-5d72175f-1734-4ab6-8cb4-b296de1e932d req-44ba51b5-1470-4706-a4f1-733c48ae3703 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082861 May 13 16:24:57.586181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 134/253] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:24:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:24:57.599007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:57.599841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:57.616122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.617125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.618040 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.621530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.717004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:24:57.717652 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:24:57.720259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:24:57.721019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:24:57.721551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:24:57.752353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.754615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.757461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.758156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.798522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:24:57.809375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:24:57.823169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:24:57.827708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:24:57.913930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:57.923554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-38675157-ad97-4db6-b5ef-3f70295f211b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1507 microversion: 2.1 time: 0.333366 May 13 16:24:57.924080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 135/254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:57 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:57.928513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:57.929171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:57.936926 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.937433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.938229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.938676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:57.975661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4f90d99f-f6bd-4e88-91c9-9b983c35792d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.225152 May 13 16:24:57.976680 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 120/255] 10.222.0.42 () {62 vars in 1188 bytes} [Thu May 13 16:24:56 2021] POST /compute/v2.1/servers => generated 400 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 16:24:57.987786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:57.988967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:57.998554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:57.999218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.000435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.002872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.216693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:58.225918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4fb68d34-440a-4e51-8c50-b15d82f4abe0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.300720 May 13 16:24:58.226591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 136/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:57 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:58.234716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:58.234716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:58.294357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Invalid volume: volume 1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70 is already attached to instances: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 May 13 16:24:58.295107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 400 to user: Invalid volume: volume 1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70 is already attached to instances: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:24:58.297916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-72950298-1b10-4eb2-9e90-abf020d6b3cc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.316975 May 13 16:24:58.306914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 121/257] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:24:57 2021] POST /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f/os-volume_attachments => generated 174 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 16:24:58.324781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:58.324781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:58.331169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:58.340972 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.343981 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.344934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.349631 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:58.349788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.349881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:58.351518 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-00dca35f-1c65-4c73-94ff-43882a26e205 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1282 microversion: 2.20 time: 0.123151 May 13 16:24:58.352472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 137/258] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:24:58 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:24:58.432468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:58.433370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:58.442301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.442914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.443966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.444555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.650917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:58.660646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-568c8480-bdce-42b8-b9aa-dcb10cf31d25 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.345704 May 13 16:24:58.662411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 122/259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:58 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:24:58.670045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:24:58.671422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:58.682393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.683322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.684497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:58.686332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:58.706583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'services' on Instance uuid 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:24:59.097982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-232bc960-edfe-4d43-b718-d798491b530d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1/os-volume_attachments/1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70" status: 202 len: 0 microversion: 2.1 time: 0.669576 May 13 16:24:59.098656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 138/260] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:24:58 2021] DELETE /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1/os-volume_attachments/1bbaf95f-7b8e-4a0d-8a7e-fa78726f8b70 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:24:59.168716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-87ff3435-b9c9-4a35-b566-9da0d89f2639 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.505896 May 13 16:24:59.170330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 123/261] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:24:58 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:24:59.250802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:59.251524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:59.265523 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:59.266425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:59.268124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:59.268931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:59.372643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:59.373503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:59.531152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:59.539890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:59.546589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:59.553411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-37ea2d87-3ac6-4003-82fb-3b5c3a13ad3c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1282 microversion: 2.20 time: 0.185271 May 13 16:24:59.554272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 124/262] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:24:59 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:24:59.565161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:24:59.574577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d290cb97-b6a1-428b-a7bd-903d414488ec tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.328059 May 13 16:24:59.584294 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 139/263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:59 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:24:59.680957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:24:59.681967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:24:59.690868 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:59.691326 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:24:59.692118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:24:59.692567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.099593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:00.115617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8881b322-f95a-4e71-b8b6-a395ab8f21a8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.439263 May 13 16:25:00.119315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 125/264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:24:59 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:00.182084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:00.183160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:00.190682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.191139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.191918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.192361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.531933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d8f39e39-2eb0-484d-b4e4-aaeeda0331fc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.354033 May 13 16:25:00.532600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 140/265] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:00 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:00.572625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:00.573454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:00.582173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.583070 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.584059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.584502 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.592987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:00.593738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:00.602282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.603143 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.604045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:00.604521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:00.781218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:00.791593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:00.793463 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:00.794947 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8cdd8048-9f0d-491f-abbf-dfd1593f87b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1334 microversion: 2.20 time: 0.227020 May 13 16:25:00.795584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 126/266] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:00 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1334 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:00.872165 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:00.880740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-afa90d31-6c90-487f-ada0-d2e0c82f8a31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.292000 May 13 16:25:00.881950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 141/267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:00 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:01.144414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:01.145043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:01.156117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.156681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.157504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.157961 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.544745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:01.546443 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:01.554114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.555014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.556080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.556730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.647664 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:01.657410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-413c4f9a-5f45-4de7-a9b6-620a203908ca tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1520 microversion: 2.1 time: 0.526551 May 13 16:25:01.658040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 127/268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:01 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:01.818329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a8d3c142-6dd9-4607-be3e-9828dd0842f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.276978 May 13 16:25:01.822795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:01.822795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:01.832861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 142/269] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:01 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:01.854416 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.854907 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.860491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.860491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.900949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:01.901802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:01.911597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.912083 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.912935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:01.913452 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:01.987375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:01.998427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:02.000518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:02.001896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-71ecad4e-2b88-4130-802b-fe9f1e0e3ad2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1334 microversion: 2.20 time: 0.192133 May 13 16:25:02.013136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 128/270] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:01 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1334 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:02.431406 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:02.439625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a6a7e7d6-6395-4bd8-8ae5-158ee5a7f77a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1318 microversion: 2.1 time: 0.544817 May 13 16:25:02.440193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 143/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:01 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:02.674815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:02.675450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:02.684228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:02.684685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:02.685741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:02.686195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:02.832082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:02.833030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:02.841845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:02.842290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:02.843223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:02.843817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.025842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:03.035883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5a6e9d48-72cd-4d4b-9cd9-9fae540e16de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1500 microversion: 2.1 time: 0.364728 May 13 16:25:03.037735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 129/272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:02 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1500 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:03.045203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302147276", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "364f9ea7-bb68-4d81-80ce-70cec45c9d8c"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:03.048498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bc146398-f21e-4d3d-bc7e-b254856cc719 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.216211 May 13 16:25:03.058889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 144/273] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:02 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:03.065945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:03.066654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:03.079012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.080159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.081358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.082761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.134756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] validate_networks() for [('364f9ea7-bb68-4d81-80ce-70cec45c9d8c', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:25:03.219183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:03.228579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:03.230370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:03.231809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-00afae2a-1b5c-49dc-b2b3-bf29334b30f1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1352 microversion: 2.20 time: 0.171622 May 13 16:25:03.232370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 145/274] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:03 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:03.237170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:03.237790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:03.245371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.246082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.246880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.247321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.684590 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:03.693292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6f73633a-2630-46a3-a07a-13b1e58de865 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1514 microversion: 2.1 time: 0.459678 May 13 16:25:03.702941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 146/275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:03 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:03.723307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:03.724649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:03.739774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.740459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:03.741372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:03.742045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.088057 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:04.100300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8f3d0781-524c-4b3d-8825-365db1fac489 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1506 microversion: 2.1 time: 0.395605 May 13 16:25:04.101868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 147/276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:03 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:04.107942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:04.108975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:04.127016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.127016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.127016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.127016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.229504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:25:04.231875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:25:04.232593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:25:04.233198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:25:04.233821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:25:04.250095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.250784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.255061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.255061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.270428 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:25:04.275214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for user 4884755f5b1a48cb8e5ff82429a30a31 and project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:25:04.286490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:25:04.288731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:25:04.361536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e1609cbb-91b2-4016-96c5-b876834bb394 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.258049 May 13 16:25:04.367736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 148/277] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:04 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:04.376211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:04.376919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:04.385912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.386610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.387396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:04.387998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:04.489891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1c450fb9-ff28-4070-b2e4-8113414bfaf2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447696 May 13 16:25:04.491327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 130/278] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:25:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:25:04.529758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0f01404e-bf43-4950-9f32-f39fe18399c4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:04.547682 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0f01404e-bf43-4950-9f32-f39fe18399c4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:04.830308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0f01404e-bf43-4950-9f32-f39fe18399c4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:04.853302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0f01404e-bf43-4950-9f32-f39fe18399c4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1218 microversion: 2.1 time: 0.337031 May 13 16:25:04.854120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 131/279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:04 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1218 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:05.073653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:05.087794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:05.089765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:05.092603 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-67b69181-1292-4aba-9f8c-40cd1568d72d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.721276 May 13 16:25:05.093209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 149/280] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:04 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:05.380466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:05.387565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:05.395225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:05.396229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:05.397505 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:05.398364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:05.616227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-290ef38d-c617-4c67-9a62-05727e31fbba tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28607 microversion: 2.1 time: 0.239224 May 13 16:25:05.617562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 132/281] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:05 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28607 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:05.872562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:05.873540 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:05.887412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:05.887865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:05.890234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:05.890398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.070438 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:06.084778 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-58696ee9-f8be-4c38-93f0-daf5e28d7ed6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1222 microversion: 2.1 time: 0.217309 May 13 16:25:06.086321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 150/282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:05 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:06.114498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:06.115628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:06.129501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.133152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.133152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.133152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.389366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-251126be-395b-4e1e-85b3-f8685b887645 req-03cc978d-118c-4491-92cb-82235e4f4375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:06.390981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:06.390981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:25:06.400178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-251126be-395b-4e1e-85b3-f8685b887645 req-03cc978d-118c-4491-92cb-82235e4f4375 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.400624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-251126be-395b-4e1e-85b3-f8685b887645 req-03cc978d-118c-4491-92cb-82235e4f4375 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.426305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-251126be-395b-4e1e-85b3-f8685b887645 req-03cc978d-118c-4491-92cb-82235e4f4375 service nova] Creating event network-changed:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:25:06.431717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-251126be-395b-4e1e-85b3-f8685b887645 req-03cc978d-118c-4491-92cb-82235e4f4375 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046106 May 13 16:25:06.432344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 151/283] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:25:06.622582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:06.624340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:06.633784 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.635190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.636030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.636564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.661525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:06.676667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:06.678273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:06.679325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-142f3850-7edb-4a93-b18e-c5f573d0749c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.569490 May 13 16:25:06.679899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 133/284] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:06 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:06.694794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:06.695760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:06.704378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.705683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.706607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:06.707127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:06.716367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'flavor' on Instance uuid a5c7c299-cc4b-4299-b6af-e0b4e21580e4 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:25:06.895635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-75b96c34-4d08-4b3d-9ccb-6fe28f4d2de1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 28639 microversion: 2.1 time: 0.214145 May 13 16:25:06.897147 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 134/285] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:06 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 28639 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:07.106037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:07.107426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:07.118225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.119626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.120861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.121430 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.143996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c3bb9694-9112-46c2-bac3-8315e301962a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action" status: 200 len: 32 microversion: 2.1 time: 0.526011 May 13 16:25:07.143996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 152/286] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:06 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action => generated 32 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:25:07.170928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:07.171778 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:07.190038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.203408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.203408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.203408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.505375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:07.522824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0340b570-2ea4-44e6-84f5-79ac0550702c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.368804 May 13 16:25:07.524424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 153/287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:07 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:07.544603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:07.565955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7b2b1279-4d0e-4e22-a790-3747a6768cd3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1270 microversion: 2.1 time: 0.466227 May 13 16:25:07.566560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 135/288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:07 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1270 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:07.699698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:07.700336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:07.709587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.710070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.710822 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.711621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.907575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:07.908708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:07.917643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.919305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:07.920901 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:07.921626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:08.069913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:08.086495 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:08.088730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:08.094635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1dfa6da4-3564-4593-b9cf-02693899f05c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.396236 May 13 16:25:08.094635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 154/289] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:07 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:08.182138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d57a9058-664f-4e29-b181-a51aa5b26fca tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 29604 microversion: 2.1 time: 0.278284 May 13 16:25:08.187595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 136/290] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:07 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 29604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:08.544284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:08.546075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:08.563693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:08.564551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:08.565596 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:08.566566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:08.587279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:08.590000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:08.612244 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:08.612880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:08.613861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:08.614479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:08.809114 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:08.818926 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8e4932f3-d284-4c21-8d55-19b106daebe9 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1276 microversion: 2.1 time: 0.239059 May 13 16:25:08.819655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 137/291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:08 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:09.098297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:09.109422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:09.110053 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:09.124288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f869f10d-3ee7-44ea-accd-816421c6ae77 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.585584 May 13 16:25:09.128558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.129019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:09.129323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 155/292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:08 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:09.132085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.132548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:09.194721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:09.195662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:09.208838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.209519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:09.210138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.210588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:09.464280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ab7ad772-f63e-4fdd-83b1-dfdaf5c2cb15 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 30589 microversion: 2.1 time: 0.272557 May 13 16:25:09.469156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 156/293] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:09 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 30589 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:09.612515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:09.625239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:09.626964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:09.628313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-decc846f-5aa2-4861-9a34-ede63bada58e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.523632 May 13 16:25:09.629384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 138/294] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:09 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:09.837657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:09.838593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:09.846566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.847032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:09.847846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:09.848292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.140346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:10.140971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:10.160461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.160956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.161782 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.162230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.420775 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:10.435304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3ee56ea5-e2fe-4ec4-9da6-c59ce9359131 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.602327 May 13 16:25:10.435904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 157/295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:09 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:10.477644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:10.479652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:10.488267 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.489119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.490205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.490874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.627002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:10.638282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a20ff5fc-0706-40b5-94da-9524c2c58ec0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.501688 May 13 16:25:10.640503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 139/296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:10 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:10.654863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:10.655951 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:10.667611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.668058 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.669097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:10.670186 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:10.716448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c122aec3-1c55-4f7d-8e8b-79552399dd9e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 31250 microversion: 2.1 time: 0.242800 May 13 16:25:10.717387 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 158/297] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:10 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 31250 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:10.914626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:10.924706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:10.926566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:10.927719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e853f54d-99ea-44f0-9a6d-e9250c7b6655 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.286002 May 13 16:25:10.928274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 140/298] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:10 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:11.228954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-b8c76b55-f849-4d74-82ec-6629492d7985 req-62f7acf2-72f5-4126-bcf2-37d6fa479f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9953c737-dccb-4150-a5e9-6717bbb4d2b8", "tag": "1e3d58e9-548a-4f57-9adf-60940a4391b7"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:11.228954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:11.228954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:25:11.228954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-b8c76b55-f849-4d74-82ec-6629492d7985 req-62f7acf2-72f5-4126-bcf2-37d6fa479f18 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.228954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-b8c76b55-f849-4d74-82ec-6629492d7985 req-62f7acf2-72f5-4126-bcf2-37d6fa479f18 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.230353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-b8c76b55-f849-4d74-82ec-6629492d7985 req-62f7acf2-72f5-4126-bcf2-37d6fa479f18 service nova] Creating event network-changed:1e3d58e9-548a-4f57-9adf-60940a4391b7 for instance 9953c737-dccb-4150-a5e9-6717bbb4d2b8 on hv-cinder-68948 May 13 16:25:11.230353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-b8c76b55-f849-4d74-82ec-6629492d7985 req-62f7acf2-72f5-4126-bcf2-37d6fa479f18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037331 May 13 16:25:11.230353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 159/299] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:25:11.452308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:11.453565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:11.462924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.464194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.465266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.466013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.658287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:11.658991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:11.667370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.668213 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.669326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.669985 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.750583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:11.759033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-15646f98-2f06-4645-80ca-b6ab8847e016 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.310673 May 13 16:25:11.759890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 141/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:11 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:11.764675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:11.765755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:11.773294 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.778880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.778880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.778880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.928291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:11.936644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-93dfbb55-d773-4f4f-b7e0-e98677fc7a0d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.282485 May 13 16:25:11.937248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 160/301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:11 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:11.945695 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:11.946332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:11.953727 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.958141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.958141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:11.958141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:11.998836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f6f09974-ab28-477d-9831-ece2d91a05cc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 32156 microversion: 2.1 time: 0.237233 May 13 16:25:11.999439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 142/302] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:11 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 32156 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:12.299044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:12.309277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:12.311092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:12.312202 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4c8efdb7-3a33-427c-bc43-1f3ba3c1fed2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.370075 May 13 16:25:12.325681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 161/303] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:11 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:12.780985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:12.780985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:12.786993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:12.787623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:12.788769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:12.789896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:12.953940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:12.954575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:12.966408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:12.966883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:12.967719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:12.968174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:13.037373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:13.047313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-90acfdc5-d55d-4d33-8f4b-1f0834a2a706 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.274782 May 13 16:25:13.048382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 143/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:12 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:13.061295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:13.064978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:13.077891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:13.078461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:13.079394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:13.079842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:13.289239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-595d8608-10f8-469f-b7ec-271bd33cc371 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 32907 microversion: 2.1 time: 0.239425 May 13 16:25:13.290065 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 144/305] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:13 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 32907 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:13.332965 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:13.333757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:13.347509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:13.351911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:13.353216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:13.354970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:13.401040 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:13.421702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60dfe05e-0519-4336-b287-dd4fd2a86294 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.471479 May 13 16:25:13.438807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 162/306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:12 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:13.627473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:13.640706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:13.642930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:13.643668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b22ee20a-01ad-4a8e-ae6b-fa519681c594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.314927 May 13 16:25:13.644401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 145/307] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:13 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:14.063794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:14.064428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:14.077152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.077152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.077152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.077152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.302403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:14.303379 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:14.308410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:14.311654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.312307 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.313122 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.313565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.317174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-25d7a46f-b0e9-4379-a30f-76377052fa32 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.257017 May 13 16:25:14.317645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 163/308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:14 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:14.446892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:14.448504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:14.455854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.456665 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.457735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.458257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.503676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-360c44d4-43d1-42d5-a6a1-159148e8fecc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 33198 microversion: 2.1 time: 0.204699 May 13 16:25:14.509919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 146/309] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:14 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 33198 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:14.663002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:14.663779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:14.672614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.673170 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.674041 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:14.674552 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:14.697413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:14.709991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0937e271-e7ff-44aa-b5ed-87c23d91a987 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.267711 May 13 16:25:14.711416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 164/310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:14 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:14.946062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:14.957166 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:14.959597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:14.961065 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9c091843-b629-4217-813e-6a86289e7d17 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.302682 May 13 16:25:14.962557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 147/311] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:14 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:15.341832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:15.341832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:15.349324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.349787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.350597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.351047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.522619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:15.525205 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:15.533227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.533930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.534804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.535345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.603957 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:15.619870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b6791426-19cf-45ff-bb03-edfce3ba36dc tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.288666 May 13 16:25:15.620462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 165/312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:15 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:15.728199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:15.729232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:15.736601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.737055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.737884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.738323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.762542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4b858d59-b5ce-4f80-88d7-6ad3d3362ba6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 33530 microversion: 2.1 time: 0.249942 May 13 16:25:15.763205 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 148/313] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:15 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 33530 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:15.944678 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:15.953714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ab0e4344-cb35-4940-924d-0f63480ff9a2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.229302 May 13 16:25:15.954323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 166/314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:15 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:15.981169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:15.982014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:15.990270 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.990839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:15.991720 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:15.992174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.197136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:16.206102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:16.207630 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:16.208757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d2da9804-3011-4dfc-80e3-af6c5e751b34 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.232604 May 13 16:25:16.209773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 149/315] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:15 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:16.636793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:16.638248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:16.645439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.645894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.646681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.647209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.776645 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:16.782453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:16.788964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.789839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.790853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.791489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.869058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:16.878624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f6a01189-2e95-4960-95eb-de3e136a03cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.245665 May 13 16:25:16.879211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 167/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:16 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:16.971838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:16.972785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:16.982627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.983092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:16.983890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:16.984327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:17.071510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f7d3290d-1965-4f63-9af7-df82e644892e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 33656 microversion: 2.1 time: 0.300017 May 13 16:25:17.072337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 150/317] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:16 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 33656 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:17.240945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:17.241973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:17.253917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:17.254915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:17.256534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:17.257232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:17.339638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:17.348373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-345f9f77-92f8-4902-9ee3-557484a84f95 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.381000 May 13 16:25:17.348951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 168/318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:16 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:17.568539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-da9fe126-8950-4119-a607-27bf0dca831f req-dabce767-0401-4e80-ac99-a094338a717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "name": "network-vif-plugged", "status": "completed", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:17.570862 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:17.570862 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:25:17.582636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-da9fe126-8950-4119-a607-27bf0dca831f req-dabce767-0401-4e80-ac99-a094338a717f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:17.583616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-da9fe126-8950-4119-a607-27bf0dca831f req-dabce767-0401-4e80-ac99-a094338a717f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:17.604563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-da9fe126-8950-4119-a607-27bf0dca831f req-dabce767-0401-4e80-ac99-a094338a717f service nova] Creating event network-vif-plugged:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:25:17.606225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:17.610711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-da9fe126-8950-4119-a607-27bf0dca831f req-dabce767-0401-4e80-ac99-a094338a717f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045753 May 13 16:25:17.611534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 169/319] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:25:17.619242 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:17.620855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:17.622135 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4496c8a7-9fe9-4581-b9cb-22585f762809 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.392475 May 13 16:25:17.623260 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 151/320] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:17 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:17.901251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:17.902620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:17.913002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:17.913763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:17.914598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:17.915895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.085451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:18.087604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:18.096756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.098101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.099126 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.099735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.314212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:18.322981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d5fec2a2-812b-4a9b-be4a-5d96b55b30e3 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.429154 May 13 16:25:18.323900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 170/321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:17 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:18.366504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:18.367264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:18.375258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.375726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.376554 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.377271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.602843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:18.614343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-242204bb-678b-4e44-be93-be7251db8263 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.251976 May 13 16:25:18.615393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 171/322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:18 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:18.663290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:18.663980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:18.687132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.687132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.687132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:18.687132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:18.873584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9987a28d-756e-46b4-81af-7f6e17b8b2a7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 34280 microversion: 2.1 time: 0.792271 May 13 16:25:18.874882 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 152/323] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:18 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 34280 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:25:19.016556 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:19.025261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:19.026847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:19.027927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6602fa01-208c-4f5a-bdfe-cc753d8d4971 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.391114 May 13 16:25:19.028478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 172/324] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:18 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:25:19.341390 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:19.342191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:19.351435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.352001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:19.353458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.353966 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:19.569960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:19.578698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b6aadc1f-449f-4fe0-9aee-44cab575b579 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.241982 May 13 16:25:19.579440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 153/325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:19 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:19.631574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:19.632195 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:19.639951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.640372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:19.641193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.641629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:19.856353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:19.864920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8b444473-d5ca-4ec0-b6da-c26c967c319c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.237038 May 13 16:25:19.865526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 173/326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:19 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:19.889620 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:19.890535 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:19.898116 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.898580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:19.899999 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:19.900439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.046317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:20.046850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:20.054069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.055526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.055526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.055923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.130494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fed65e9e-7158-4b5e-ad83-a1d8258caaa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 34863 microversion: 2.1 time: 0.242170 May 13 16:25:20.131439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 154/327] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:19 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 34863 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:20.269344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:20.278166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:20.279687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:20.281677 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-06acfb9e-29fb-4b2c-b2e0-ef23f3c9bf8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1406 microversion: 2.20 time: 0.238321 May 13 16:25:20.281677 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 174/328] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:20 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:20.596660 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:20.597429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:20.605744 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.606223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.607016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.607482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.816110 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:20.825565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4d0df9e0-312b-46ef-8136-8b20f09480e0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.233046 May 13 16:25:20.826471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 155/329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:20 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:20.882068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:20.882686 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:20.890880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.891327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:20.892116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:20.892546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.108369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:21.117068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e7e01a48-a1a0-4d66-81a0-492ede54adb0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.238884 May 13 16:25:21.117666 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 175/330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:20 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:21.144869 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:21.146323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:21.155175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.158407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.158407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.158407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.299365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:21.300090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:21.308368 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.308822 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.309646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.310082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.327409 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-750a403f-0efb-44b8-acdd-f4f0e981632d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 35272 microversion: 2.1 time: 0.188352 May 13 16:25:21.328057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 156/331] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:21 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 35272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:21.512609 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:21.521604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:21.523059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:21.524274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-013d26f3-38c0-43a1-9fb6-424d137f76eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1598 microversion: 2.20 time: 0.229305 May 13 16:25:21.524833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 176/332] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:25:21 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1598 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:21.550413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:21.551020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:21.559999 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.560457 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.561317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.570174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.719754 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fa75ac60-f783-47c0-9bdb-6775f72a5f55 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.173746 May 13 16:25:21.720533 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 157/333] 10.222.0.42 () {60 vars in 1316 bytes} [Thu May 13 16:25:21 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:21.842460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:21.843276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:21.851199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.856312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:21.856312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:21.856312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:22.134772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:22.135584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:22.148809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:22.148809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:22.148809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:22.148809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:22.340636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:22.351950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-483ef5e8-0e77-40fc-a956-3b180b5bcddd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.513075 May 13 16:25:22.353676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 177/334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:21 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:22.368799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:22.370874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:22.378508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:22.382589 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:22.383103 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:22.384686 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:22.385148 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:22.388580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-04aa88df-8117-4056-a3bd-7a036eb6e22d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.257611 May 13 16:25:22.389229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 158/335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:22 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:22.573697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4f3c1f76-0db9-40b3-8d4e-23daba63cd1e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 36173 microversion: 2.1 time: 0.217880 May 13 16:25:22.574764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 178/336] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:22 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 36173 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:23.370787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:23.371586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:23.381266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.381266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.381549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.382159 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.422077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:23.423409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:23.432102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.432726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.435794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.435794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.773695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:23.784557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-463f46f3-41ea-4e45-ab92-3ab93ec0d678 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.418301 May 13 16:25:23.785555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 159/337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:23 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:23.797333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:23.799091 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:23.813233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.813233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.813233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.813233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.864763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:23.876022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6bd0b3c5-997c-48f2-a308-121efe87d860 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.457860 May 13 16:25:23.878613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 179/338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:23 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:23.981517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:23.982718 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:23.991938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.992392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:23.993426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:23.993853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:24.033382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-30e91144-6462-49d9-b114-e9d876b58abb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 36923 microversion: 2.1 time: 0.246263 May 13 16:25:24.034881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 160/339] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:23 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 36923 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:24.043521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-b9fb89c2-e8b4-41d8-9988-52fde77cc2a2 req-373561de-51e7-436c-bfd5-e95c4870f976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:24.045340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:24.045340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:25:24.055898 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-b9fb89c2-e8b4-41d8-9988-52fde77cc2a2 req-373561de-51e7-436c-bfd5-e95c4870f976 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:24.056419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-b9fb89c2-e8b4-41d8-9988-52fde77cc2a2 req-373561de-51e7-436c-bfd5-e95c4870f976 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:24.073566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-b9fb89c2-e8b4-41d8-9988-52fde77cc2a2 req-373561de-51e7-436c-bfd5-e95c4870f976 service nova] Creating event network-changed:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:25:24.082209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-b9fb89c2-e8b4-41d8-9988-52fde77cc2a2 req-373561de-51e7-436c-bfd5-e95c4870f976 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045675 May 13 16:25:24.083240 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 161/340] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:25:24.190183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0a440c7c-2f27-4b20-914b-17d5900885d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.213281 May 13 16:25:24.191205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 180/341] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:23 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:24.804137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:24.804871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:24.816592 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:24.817180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:24.818013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:24.818462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:24.896337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:24.897397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:24.938320 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:24.938789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:24.939980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:24.940444 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:25.196811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:25.204821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7e8fb82c-d782-4322-b255-3cc151a2d124 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.405937 May 13 16:25:25.206117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 162/342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:24 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:25.223085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:25.224238 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:25.236033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:25.236488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:25.237324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:25.237768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:25.404136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:25.414837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0a90006f-8ccf-47e4-a1ae-7f2409af6dc7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.523633 May 13 16:25:25.415453 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 181/343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:24 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:25.420075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:25.421046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:25.428920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:25.429232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:25.430091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:25.431021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:25.448221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4ac2e1d7-1c01-4c94-8643-17778144a355 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 37721 microversion: 2.1 time: 0.238767 May 13 16:25:25.449181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 163/344] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:25 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 37721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:25.614937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c5b68018-aae3-46ad-984f-8cad0e63808e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.198138 May 13 16:25:25.615804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 182/345] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:25 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:26.230197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:26.230197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:26.236101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.236101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.236870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.237487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.432797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:26.433534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:26.441664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.442315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.443292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.444002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.491430 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:26.500330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4f3b33ed-b749-4c64-b955-0279262633f0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.279562 May 13 16:25:26.501286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 164/346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:26 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:26.518230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:26.518900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:26.527456 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.528162 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.529173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.529771 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.706963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:26.715170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7eda814-de8b-4379-8234-1d05cff55496 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.286722 May 13 16:25:26.715745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 183/347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:26 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:26.720294 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:26.726524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:26.727945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4721bd62-76b5-4e3e-943d-1b5f9a7ce35d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 38085 microversion: 2.1 time: 0.214441 May 13 16:25:26.728679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 165/348] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:26 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 38085 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:26.729436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.729895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.731021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:26.731462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:26.886871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3f3a8d9b-b8a1-4608-bfc1-39bcaacef6e9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.169740 May 13 16:25:26.887525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 184/349] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:26 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:27.522940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:27.525105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:27.542663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.543597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.544777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.545498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.734706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:27.734706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:27.742788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.743680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.745220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.745220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.771839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:27.782677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1faea41a-9ddb-4bd2-abcf-b83e65747ff6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.264493 May 13 16:25:27.784135 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 166/350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:27 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:27.791561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:27.792781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:27.801393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.802592 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.803998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:27.824483 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:27.995624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:28.003948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-02224a56-a610-408a-8412-7ce9efb03d13 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.275205 May 13 16:25:28.004519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 185/351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:27 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:28.009668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:28.010579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:28.017725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.018183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:28.018970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.019407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:28.029402 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a665d8d3-360b-4fd4-bd7d-f2d0c903d479 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 200 len: 38204 microversion: 2.1 time: 0.239243 May 13 16:25:28.034955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 167/352] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:27 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 38204 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:25:28.041298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:28.042136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:28.050753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.051296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:28.052314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.052776 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:28.117426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-272d5b65-2191-4f11-bc74-c3e700868d61 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/ips" status: 200 len: 146 microversion: 2.1 time: 0.080413 May 13 16:25:28.118091 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 168/353] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:25:28 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/ips => generated 146 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:25:28.202477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0c99ee67-9ab8-4309-b27c-69c142a1772c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.196593 May 13 16:25:28.207974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 186/354] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:28 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:28.800257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:28.801529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:28.811287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.811749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:28.812840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:28.813347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:29.022401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:29.023108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:29.031882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:29.032336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:29.033220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:29.033661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:29.051957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:29.062022 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-859192a6-bb9f-4014-866b-74ff04049bda tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.265666 May 13 16:25:29.062994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 169/355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:28 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:29.218761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:29.219790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:29.228009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:29.228545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:29.229436 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:29.229989 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:29.285291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:29.299284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7376a9d1-d0b2-40d1-a18b-c35f53dad546 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.281548 May 13 16:25:29.299867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 187/356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:29 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:29.403003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1afae29c-5d05-4aac-925c-c6c80d69c720 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.187904 May 13 16:25:29.403861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 170/357] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:29 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:30.079577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:30.080369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:30.089058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.089542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.090335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.091055 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.316578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:30.317237 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:30.327386 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.328207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.329397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.330259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.342158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:30.351703 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-837fcc3d-e02a-4ff3-a3c9-8efd7375594c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.275983 May 13 16:25:30.353178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 188/358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:30 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:30.418527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:30.419945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:30.428951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.429501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.431550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:30.432081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:30.646323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a6549ec8-9840-4ee1-b422-75b1fcfb51a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.232013 May 13 16:25:30.647639 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 189/359] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:30 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:30.714297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:30.722885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-86ca968f-a75e-4e25-8bc0-b6df0c038730 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.410659 May 13 16:25:30.723518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 171/360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:30 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:31.371256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:31.372001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:31.380463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.387439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.387439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.387439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.657712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:31.658857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:31.659861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:31.669029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.669728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.670720 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.671047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1832bc37-4ca6-409c-a494-7e7c8b68bb12 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.304613 May 13 16:25:31.673055 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.673184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 190/361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:31 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:31.740752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:31.741445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:31.750347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.750804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.751588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:31.752101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:31.956812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:31.965161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-943b213e-e38d-4a58-bd18-99368aa2a895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.228100 May 13 16:25:31.965786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 191/362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:31 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:32.688602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:32.689265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:32.697940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:32.698395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:32.699174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:32.699612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:32.891547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:32.899731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c35c5b8c-1f43-452f-bd78-3febec19748d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.214927 May 13 16:25:32.900292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 192/363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:32 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:32.983085 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:32.983875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:32.991469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:32.991951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:32.993286 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:32.993756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:33.194373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:33.203152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e8140cdd-617a-4b9d-89f3-a28c40cb3ce8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.224470 May 13 16:25:33.203708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 193/364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:32 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:33.916279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:33.916906 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:33.924116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:33.924581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:33.925465 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:33.925914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:34.119995 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:34.128094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9bd7a9a7-6eaf-4328-82f2-128977d33b9a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.216109 May 13 16:25:34.128651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 194/365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:33 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:34.219508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:34.220124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:34.227439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:34.228267 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:34.229049 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:34.229544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:34.421934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:34.430045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f1372deb-e1ab-4cda-934e-4aec04f22ffb tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.214213 May 13 16:25:34.430605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 195/366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:34 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:35.145267 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:35.145956 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:35.154129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:35.154612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:35.155682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:35.156118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:35.368381 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:35.376634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a7b74cbb-edc4-4bd1-a8f9-7fb7ddcb4650 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.235242 May 13 16:25:35.377222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 196/367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:35 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:35.447987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:35.448605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:35.456013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:35.456466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:35.457338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:35.457778 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:35.516605 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fd39ced7-1c59-4e09-9b11-85e34e91e7c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 3.861103 May 13 16:25:35.517973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 172/368] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:31 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 3864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:35.671237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:35.679446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f48a6a0c-48d9-4469-ab03-0ebfdd70e270 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.235743 May 13 16:25:35.680003 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 197/369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:35 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:36.396791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:36.397607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:36.406841 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.407170 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.408042 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.408519 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.529148 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:36.530684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:36.538242 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.538705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.539541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.539992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.627039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:36.635338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3ea1cd6d-5725-44c4-a07b-ed93130851fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.242716 May 13 16:25:36.635909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 173/370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:36 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:36.693098 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6f2e5de6-30fa-4117-8d91-d36e2602e66e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.167896 May 13 16:25:36.696413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 198/371] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:36 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:36.696547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:36.696645 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:36.703906 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.704354 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.709437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:36.709437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:36.901195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:36.909331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-25e62704-78ae-4a17-94ba-e9024cc95886 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.216904 May 13 16:25:36.909901 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 174/372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:36 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:37.537911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f67fc3f1-9ed0-45cd-8ffc-c511c2466771"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:37.539240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:37.547476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:37.548188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:37.549113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:37.552601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:37.662241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:37.662867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:37.677694 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:37.678169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:37.679018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:37.679674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:37.888454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:37.896625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-71ea196e-d576-47bc-a8e8-ae2cf8b82942 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.248529 May 13 16:25:37.897228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 175/373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:37 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:37.901632 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-498654713", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "6e369916-a5a7-4b77-95bf-81af0f82aa4a"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:38.644233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-96064f20-a509-4a54-b18a-9e3328cb892b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111193 May 13 16:25:38.644863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 199/374] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:25:37 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-volume_attachments => generated 194 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:25:38.650025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:38.651071 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:38.660811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:38.661463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:38.662561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:38.663152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:38.843319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6235e0e1-360f-4094-a9b6-b879f50d2ec1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.196986 May 13 16:25:38.846482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 200/375] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:38 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:38.849111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:38.849817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:38.858839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:38.859298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:38.860107 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:38.860536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:39.126511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:39.151106 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0f84c533-75f1-46da-a961-45f1eb1dafd5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.305759 May 13 16:25:39.151697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 201/376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:38 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:39.156088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:39.156701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:39.164292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:39.164777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:39.166233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:39.166738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:39.369573 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:39.377899 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-41f2cf33-fdc1-4c0a-bd93-d18fa8613614 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.225193 May 13 16:25:39.378480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 202/377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:39 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:39.854869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:39.856131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:39.863889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:39.864340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:39.874069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:39.874069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:40.017831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-10fe8daa-0236-47d8-a818-29c9b84db851 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.167079 May 13 16:25:40.018492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 203/378] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:39 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:40.170801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:40.171418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:40.179429 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:40.179891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:40.181347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:40.184543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:40.382331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:40.391080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c5673d89-8fb5-4640-9d7a-94fee982ff52 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.224439 May 13 16:25:40.391694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 204/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:40 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:40.396019 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:40.396629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:40.404881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:40.405405 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:40.406236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:40.406752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:40.623920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:40.632457 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0ccc6f9d-adc1-4afe-b5d8-dc44f6c2053c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.239759 May 13 16:25:40.633017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 205/380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:40 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:41.028544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:41.029646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:41.038048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.038596 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.039584 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.040608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.212642 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-990b8810-8a92-4190-a76e-4591c3f7e0f3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.187904 May 13 16:25:41.213327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 206/381] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:41 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:41.409275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:41.410095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:41.418577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.419029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.421375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.421375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.628685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:41.637101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-169cfbd4-5d81-41a0-85d4-ddc11d374cb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.232111 May 13 16:25:41.637669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 207/382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:41 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:41.649041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:41.649729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:41.657761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.658220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.659023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:41.659540 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:41.869638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:41.878184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-30cac588-027c-4ed7-be2c-17068f2ec2be tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.232773 May 13 16:25:41.878753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 208/383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:41 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:42.223640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:42.224541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:42.232198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.232652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:42.233465 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.233904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:42.402465 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-94854a70-1a3e-469c-beca-4fc30e8e03d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 14 microversion: 2.20 time: 0.181532 May 13 16:25:42.403062 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 209/384] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:42 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:42.655743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:42.656511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:42.664492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.664954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:42.665746 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.666211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:42.908586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:42.916779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-52f71bb4-0b0e-4fc1-bd41-ebad452a4e60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.266191 May 13 16:25:42.918110 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 210/385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:42 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:42.922398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:42.923005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:42.929974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.930426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:42.931209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:42.931645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:43.133666 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:43.142627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-17845fe0-4632-4307-b571-45813c34577b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.223491 May 13 16:25:43.143200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 211/386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:42 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:43.413566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:43.414383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:43.421676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:43.422128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:43.422893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:43.423329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:43.588075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b71b2a53-e67b-4475-abf9-79320ff85f49 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 6451 microversion: 2.20 time: 0.178038 May 13 16:25:43.588972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 212/387] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:43 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 6451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:25:43.935695 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:43.936515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:43.944943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:43.945578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:43.946388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:43.946885 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:44.178794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:44.187729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4cc64d23-28b6-4e39-8b95-bf5ebe42cb42 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.257053 May 13 16:25:44.188290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 213/388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:43 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:44.192573 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:44.193206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:44.200664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:44.201133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:44.201906 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:44.202341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:44.400905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:44.410629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c5dc212d-6688-415a-8577-3a471303e4fb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.221222 May 13 16:25:44.413344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 214/389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:44 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:44.599805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:44.600710 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:44.608237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:44.608685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:44.609487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:44.609947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:44.786349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60353f68-2741-4112-963e-781c3f846236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 10893 microversion: 2.20 time: 0.189991 May 13 16:25:44.787012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 215/390] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:44 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 10893 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:45.204846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:45.205590 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:45.213492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.214592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.215382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.215830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.449434 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:45.457927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4b2da564-2d3d-450b-924c-393feddf089b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.257069 May 13 16:25:45.458311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 216/391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:45 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:45.462669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:45.463273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:45.471545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.472079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.472933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.473373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.671817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:45.681948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-025f34e2-69a8-490a-99bc-4d4f5768301e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.222165 May 13 16:25:45.684886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 217/392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:45 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:45.796887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:45.797900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:45.805235 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.805693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.806469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:45.806913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:45.990473 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d938bff6-0ba1-4f7f-b732-7c30fb464546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 15025 microversion: 2.20 time: 0.197107 May 13 16:25:45.992007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 218/393] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:45 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 15025 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:46.476450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:46.477185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:46.486018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:46.486480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:46.487274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:46.487722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:46.703365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:46.711635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e0cc4ac2-d218-44d5-9004-bae45d4a5b67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.239579 May 13 16:25:46.712296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 219/394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:46 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:46.716464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:46.717070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:46.724904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:46.725430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:46.726168 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:46.726638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:46.926750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:46.935306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-27990dbf-6f27-49d4-920f-289333e0acff tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.222090 May 13 16:25:46.935871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 220/395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:46 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:47.003404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:47.003404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:47.011240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:47.011693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:47.012569 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:47.013015 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:47.182284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5599e3f7-8b17-4321-976b-e19b11db539f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 17602 microversion: 2.20 time: 0.183444 May 13 16:25:47.183859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 221/396] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:46 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 17602 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:47.682164 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2d11f1e7-0c31-4d94-bab9-66183d9892b9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:47.691291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d11f1e7-0c31-4d94-bab9-66183d9892b9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:47.691747 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d11f1e7-0c31-4d94-bab9-66183d9892b9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:47.749697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2d11f1e7-0c31-4d94-bab9-66183d9892b9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Going to try to stop instance {{(pid=93648) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 13 16:25:48.020552 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2d11f1e7-0c31-4d94-bab9-66183d9892b9 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 202 len: 0 microversion: 2.1 time: 0.342375 May 13 16:25:48.021182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 222/397] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:25:47 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:48.026717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:48.027408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:48.035346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.035818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.036650 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.037077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.249463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:48.255784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] validate_networks() for [('6e369916-a5a7-4b77-95bf-81af0f82aa4a', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:25:48.259940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cd7f244c-e054-416b-b39b-2c4c2c1df7d0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.236966 May 13 16:25:48.261005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 223/398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:48 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:48.265824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:48.266640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:48.276349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.276995 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.277970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.279100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.538969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:48.547815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7801ca81-a96f-44c9-82be-16843e340593 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.285418 May 13 16:25:48.548646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 224/399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:48 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:48.552620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:48.553254 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:48.562161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.562614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.563397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.563841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.839888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:48.850419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f524a04d-ec7c-44be-9337-878eb2583de3 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.301056 May 13 16:25:48.850999 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 225/400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:48 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:48.865186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:48.866153 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:48.874305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.874966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.875661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.876100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.899183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:25:48.899606 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:25:48.900083 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:25:48.900494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:25:48.900945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:25:48.910028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.910502 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.911337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:48.911778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:48.930707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Getting quotas for project e0bc2aa4ccfb477ebc03dad77a3f3273. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:25:48.935336 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Getting quotas for user 582d073338bb45e7a0fd76b4a662cf32 and project e0bc2aa4ccfb477ebc03dad77a3f3273. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:25:48.947222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:25:48.949749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:25:49.060222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7e0b5d9a-23a2-48d5-85b1-403509e2aef1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 17960 microversion: 2.20 time: 0.198509 May 13 16:25:49.060951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 226/401] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:48 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 17960 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:49.075967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a4d7a064-3f54-4d0d-a837-caf74fb38587 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.177598 May 13 16:25:49.076824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 176/402] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:25:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 11179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:25:49.087656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ec0c5e05-2cc3-446a-ab7f-97845dd663df tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:49.088437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ec0c5e05-2cc3-446a-ab7f-97845dd663df tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:49.168879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ec0c5e05-2cc3-446a-ab7f-97845dd663df tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:49.178031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ec0c5e05-2cc3-446a-ab7f-97845dd663df tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1213 microversion: 2.1 time: 0.094791 May 13 16:25:49.178612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 227/403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:49 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:49.276349 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:49.276963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:49.285058 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.285537 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:49.286320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.286758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:49.492738 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:49.501909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7a5d783c-d717-4ae9-91cc-f57003145e07 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.229336 May 13 16:25:49.502924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 177/404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:49 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:49.564973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:49.565616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:49.574896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.575081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:49.575870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.576547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:49.778526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:49.787053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-407cf60a-bba5-4235-8d8b-733b31e2188e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.225957 May 13 16:25:49.787624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 228/405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:49 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:49.867633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:49.868258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:49.877871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.878407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:49.879203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:49.879669 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.071836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:50.072755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:50.080159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.080617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.081436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.081882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.082563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:50.092210 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-be003f7e-3547-4de3-8b59-701ef026e782 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.228337 May 13 16:25:50.092802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 178/406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:49 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:50.195352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:50.196088 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:50.203540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.204003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.204795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.205276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.258878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1689afff-91f1-4f41-9045-4e8590411668 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 19342 microversion: 2.20 time: 0.190892 May 13 16:25:50.261804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 229/407] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:50 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 19342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:50.329926 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:50.338454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5e763d93-d9c9-4777-8622-e20e2215dd2b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1217 microversion: 2.1 time: 0.147022 May 13 16:25:50.339053 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 179/408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:50 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:50.520122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:50.521011 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:50.533479 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.536717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.537800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.538481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.745910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:50.754229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b0f02977-2250-41a1-8cac-aac6b51894f3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.238228 May 13 16:25:50.763091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 230/409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:50 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:50.803496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:50.804105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:50.814916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.815277 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:50.816112 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:50.816556 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.020991 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:51.029855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a9f0d6de-d341-449c-a2f1-bc5eea367ba4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.229943 May 13 16:25:51.030748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 180/410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:50 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:51.109804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:51.110416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:51.117963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.118409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.119192 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.119622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.278012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:51.279010 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:51.286485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.287133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.288050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.288817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.318496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:51.327078 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4fefd360-d3ec-45e6-9eb5-ba4a3c175c63 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.221018 May 13 16:25:51.328034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 231/411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:51 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:51.356656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:51.357445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:51.364702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.366310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.367472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.368064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.481545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:51.482421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e9987e4b-4b68-4654-8ce9-03d158f16ae8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 20985 microversion: 2.20 time: 0.208140 May 13 16:25:51.483488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 181/412] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:51 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 20985 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:51.496197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-510fd131-9a75-4eeb-aea8-6d0eabc68baf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1265 microversion: 2.1 time: 0.143783 May 13 16:25:51.497044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 232/413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:51 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:51.771752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:51.772597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:51.780640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.781200 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.781992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:51.782431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:51.988250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:51.997043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f3d24dcf-8cb2-4b07-9828-1f05174b320a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.229442 May 13 16:25:51.997647 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 182/414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:51 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:52.047211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:52.047753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:52.055654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.056108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.056890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.057355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.345035 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:52.346024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:52.355994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.356569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.357764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.358266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.400122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:52.409326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3f85dfe2-27b2-47e5-ae6c-650c5298bcfa tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.365813 May 13 16:25:52.409907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 233/415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:52 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:52.494175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:52.495961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:52.504001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.504774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.505830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.506549 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.688805 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:52.707652 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1411f5f3-d162-47ef-b4e9-f1ec535ef823 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.367203 May 13 16:25:52.713138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 183/416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:52 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:52.713138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:52.721773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:52.727918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2ec05b00-f5c0-4e18-a6f0-1418ffce650b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 21762 microversion: 2.20 time: 0.238453 May 13 16:25:52.734724 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 234/417] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:52 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 21762 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:52.738671 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.739346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.741272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:52.741890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:52.862221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:52.871546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0cdd0fb7-a808-40eb-abf7-5014254f5e55 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1271 microversion: 2.1 time: 0.162075 May 13 16:25:52.872231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 184/418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:52 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:53.016459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:53.017365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:53.028112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.028570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.029418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.029858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.370169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:53.380063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-178b2189-ba6b-4b11-b620-8f655adf7b80 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.368967 May 13 16:25:53.380906 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 235/419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:53 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:53.427249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:53.428112 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:53.438522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.439024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.439815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.440277 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.659471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:53.668269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4e6c59e0-1bce-48ed-af9e-7397fc52a152 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.244926 May 13 16:25:53.668858 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 185/420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:53 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:53.726382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:53.727096 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:53.735994 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.740111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.740111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.740111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.741346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:53.742368 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:53.751375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.751985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:53.752840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:53.753312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.171989 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9cdbcc23-2a1c-4f70-8805-8b0f0606d110 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 22662 microversion: 2.20 time: 0.434305 May 13 16:25:54.173351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 186/421] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:53 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 22662 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:54.178494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:54.179198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:54.180667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:54.188879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.189742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.190719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.191175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.197207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df2ef695-0521-46e2-9898-4f42ac55724c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.472831 May 13 16:25:54.197207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 236/422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:53 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:54.398894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:54.399917 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:54.410216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.410904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.412354 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.413115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.414268 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:54.425750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e2cfefa2-3473-44ad-9438-0a885c04cde7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.250976 May 13 16:25:54.426240 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 187/423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:54 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:54.665157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:54.681440 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d52fd15a-b1af-4697-acaa-c365ce0048dc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.286612 May 13 16:25:54.691577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 237/424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:54 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:54.691773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:54.691773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:54.695435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.696005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.696910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:54.697538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:54.935265 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:54.944939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-83ff79e5-825c-41d1-b9c6-5f122d6372c2 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.263694 May 13 16:25:54.945675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 188/425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:54 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:55.185436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:55.186416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:55.194100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.194559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.195356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.195792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.199333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-da96d88b-1093-495d-ad72-ae03ce8aaf60 req-705e1907-eb0a-45db-a6ac-bbadcccb3fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35323dd5-d080-4384-8f73-f3735139fa97", "tag": "59cab5c3-bb3f-467c-bdcc-d3191ffd2f54"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:55.201497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:55.201497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:25:55.219756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-da96d88b-1093-495d-ad72-ae03ce8aaf60 req-705e1907-eb0a-45db-a6ac-bbadcccb3fbb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.219756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-da96d88b-1093-495d-ad72-ae03ce8aaf60 req-705e1907-eb0a-45db-a6ac-bbadcccb3fbb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.243061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-da96d88b-1093-495d-ad72-ae03ce8aaf60 req-705e1907-eb0a-45db-a6ac-bbadcccb3fbb service nova] Creating event network-changed:59cab5c3-bb3f-467c-bdcc-d3191ffd2f54 for instance 35323dd5-d080-4384-8f73-f3735139fa97 on hv-cinder-68948 May 13 16:25:55.251134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-da96d88b-1093-495d-ad72-ae03ce8aaf60 req-705e1907-eb0a-45db-a6ac-bbadcccb3fbb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057596 May 13 16:25:55.251847 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 189/426] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:25:55.257542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:55.258340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:55.266831 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.267312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.271812 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.271812 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.488925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:55.498516 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8be89e21-5657-4d93-af40-114ca840dd22 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.245337 May 13 16:25:55.499093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 190/427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:55 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:55.503513 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:55.504125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:55.511978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.512459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.513309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.513758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.516938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b07fe0a6-ef83-4888-ba34-ced6e053bba8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 23038 microversion: 2.20 time: 0.335266 May 13 16:25:55.518327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 238/428] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:55 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 23038 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:55.699923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:55.700646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:55.714075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.714544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.715374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.715824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.771491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:55.782018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c9347f62-1411-4b97-8d2b-b2e206136001 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.281783 May 13 16:25:55.791350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 191/429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:55 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:55.800557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-77783717-102a-4dde-88f6-08d04568faa7 req-912edaba-5548-4e03-be97-6ddf8f099e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9953c737-dccb-4150-a5e9-6717bbb4d2b8", "name": "network-vif-plugged", "status": "completed", "tag": "1e3d58e9-548a-4f57-9adf-60940a4391b7"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:55.808083 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:25:55.808083 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:25:55.811796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-77783717-102a-4dde-88f6-08d04568faa7 req-912edaba-5548-4e03-be97-6ddf8f099e29 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.812312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-77783717-102a-4dde-88f6-08d04568faa7 req-912edaba-5548-4e03-be97-6ddf8f099e29 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.828694 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-77783717-102a-4dde-88f6-08d04568faa7 req-912edaba-5548-4e03-be97-6ddf8f099e29 service nova] Creating event network-vif-plugged:1e3d58e9-548a-4f57-9adf-60940a4391b7 for instance 9953c737-dccb-4150-a5e9-6717bbb4d2b8 on hv-cinder-68948 May 13 16:25:55.835404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-77783717-102a-4dde-88f6-08d04568faa7 req-912edaba-5548-4e03-be97-6ddf8f099e29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038763 May 13 16:25:55.836588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 192/430] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:25:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:25:55.966629 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:55.967342 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:55.978548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.980100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:55.981063 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:55.981798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.050629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:56.060525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-32c8e7c7-25c6-4eeb-b63a-c207b3cae778 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.364548 May 13 16:25:56.070934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 239/431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:55 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:56.223272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:56.232829 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9787da6c-3d02-4329-a546-072c7e523add tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.270561 May 13 16:25:56.233446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 193/432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:55 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:56.515950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:56.516782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:56.528537 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:56.529512 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:56.536428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.537179 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.538378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.539344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.542878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.548113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.549172 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.549625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.768780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:56.778638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-716f9b7f-d7bb-4bf1-92e3-cb906cd1d696 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.266354 May 13 16:25:56.778987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 240/433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:56 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:56.798636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:56.799251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:56.806340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.806939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:56.810635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:56.810635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.239878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:57.249809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7b42ee7e-2e3d-4f48-aba5-aeb2bd116487 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.454727 May 13 16:25:57.250397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 241/434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:56 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:57.263505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:57.264129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:57.271733 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.277285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.277285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.277285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.353496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9c52f8f4-c9ee-45c7-ac0e-de327f406b53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 23227 microversion: 2.20 time: 0.828743 May 13 16:25:57.354181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 194/435] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:56 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 23227 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:25:57.359831 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:57.360528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:57.368461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.368941 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.373718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.373718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.478868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:57.488094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-274024cb-db6c-4bb0-b4de-46cac1a3af7f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.228215 May 13 16:25:57.488864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 242/436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:57 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:57.577795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:57.586012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3c1113aa-479b-4c23-be4f-794aedef7ee6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.229981 May 13 16:25:57.586699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 195/437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:57 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:57.796894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:57.797655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:57.805211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.805671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:57.806481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:57.806921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.000954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:58.009505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a2213a86-fd14-4559-a3af-87c1b59e0953 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.216366 May 13 16:25:58.010065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 243/438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:57 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:58.266307 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:58.266983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:58.274889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.275341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.276249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.276691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.373054 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:58.374057 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:58.381447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.381904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.382699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.383145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.482801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:58.490923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d4243b1b-6fdf-4b9f-bd22-41f7940ef2f3 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.228554 May 13 16:25:58.491478 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 196/439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:58 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:58.507028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:58.507646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:58.515636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.516092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.516875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.517355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.613332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c609b7f4-83a2-4cca-b3ea-3554bf367fac tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 23795 microversion: 2.20 time: 0.244168 May 13 16:25:58.617194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 244/440] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:58 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 23795 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:58.621509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:58.622241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:58.629681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.630141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.630960 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:58.631408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:58.718644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:58.727049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-42f00926-51fc-4d07-8ca3-2756b18735d6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.223839 May 13 16:25:58.727622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 197/441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:58 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:25:58.828004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:58.836144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ebb455f5-3fd3-4f23-9265-ab62ec17fe4d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1318 microversion: 2.1 time: 0.221060 May 13 16:25:58.836741 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 245/442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:58 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:59.027297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:59.027913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:59.035223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.035679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.036460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.036904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.234498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:59.243196 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-debca022-e730-456e-b8db-4c00e5632861 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.220096 May 13 16:25:59.243765 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 198/443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:59 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:59.507897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:59.508544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:59.517460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.520340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.520340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.520340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.623978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:25:59.625296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:59.632582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.633147 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.635072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.636574 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.719865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:59.728203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2a13662a-302e-42ba-b480-eac99ca65c88 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.224329 May 13 16:25:59.728773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 246/444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:59 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:25:59.745456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:59.746081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:59.753380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.753846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.754644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.755091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.923963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-53ee9afe-08d2-4d84-9bd8-864ae40ae6ef tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 23795 microversion: 2.20 time: 0.303621 May 13 16:25:59.927894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 199/445] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:25:59 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 23795 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:25:59.929967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:25:59.930760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:25:59.938944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.939401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.940194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:25:59.940697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:25:59.958325 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:25:59.967696 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-37d289be-e859-4a08-9309-08d863ab91df tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.226512 May 13 16:25:59.968284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 247/446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:59 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:00.147802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:00.156279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-30881827-dcba-48f9-9141-93c015a7f38b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1508 microversion: 2.1 time: 0.230111 May 13 16:26:00.156764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 200/447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:25:59 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:00.259733 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:00.260352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:00.268317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.268965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.270010 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.270811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.429890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cd7e99b-e986-4b1e-8a2c-8aceab1aee7a", "device": "/dev/sdb"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:00.431586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:00.440617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.446975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.446975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.446975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.489451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:00.500698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7682e7c5-c055-4c94-b165-556d64f6190c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.244578 May 13 16:26:00.511167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 248/448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:00 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:00.745644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:00.746260 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:00.753846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.754300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.755090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:00.755530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:00.973648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:00.982160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5f75d1b7-7aa6-49b2-a1d1-45f99c2ba412 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.240193 May 13 16:26:00.982732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 249/449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:00 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:00.996647 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:00.997637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:01.004854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.005341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.006123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.006562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.217909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2b2fb827-fd22-40f3-8021-8b09b795df6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 24461 microversion: 2.20 time: 0.224428 May 13 16:26:01.218850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 250/450] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:00 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 24461 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:01.226951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:01.227791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:01.235893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.236341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.237169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.237593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.441938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:01.450639 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2bbe0d6d-907c-4934-8fb2-549c01e6ef41 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.230050 May 13 16:26:01.451222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 251/451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:01 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:01.518561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:01.519212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:01.526977 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.527503 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.535776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:01.535776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:01.617601 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-36c2120a-a10b-45dc-aed9-0efd1e614749 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "POST /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.191489 May 13 16:26:01.620400 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 201/452] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:26:00 2021] POST /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:26:01.918283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:01.926950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4547c5ec-93cd-4678-b5b1-e86c5357a4af tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.412305 May 13 16:26:01.927544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 252/453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:01 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:02.001404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:02.002121 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:02.011603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.012064 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.013073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.013545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.232733 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:02.233779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:02.238892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:02.242249 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.242699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.243492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.243962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.249183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-41005a6d-37d7-4e04-87a3-be3b1d9dd2a1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.252928 May 13 16:26:02.250219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 202/454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:01 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:02.468804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:02.469803 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:02.476337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-70919145-08b3-47c1-a246-7518aaab8e51 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 24746 microversion: 2.20 time: 0.248046 May 13 16:26:02.476990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 253/455] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:02 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 24746 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:02.480246 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.480755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.481625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.482113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.711013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:02.728178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2e0ea752-6e9b-4122-a104-635d1e860cfc tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.255456 May 13 16:26:02.728178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 203/456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:02 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:02.945151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:02.945883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:02.954653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.955160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:02.955989 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:02.956570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.123584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4330714-086f-47bf-9838-04ea91de6f1c"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:03.124700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:03.131958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.132414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.133218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.133667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.155198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:03.164737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1f4bfdfd-f883-4140-9a77-44bc239d6253 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.223792 May 13 16:26:03.165445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 254/457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:02 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:03.265932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:03.266743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:03.274765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.275214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.276615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.277073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.527377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:03.533877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d8cb237b-a5f1-45ba-ab81-d04601e86e35 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.271681 May 13 16:26:03.534448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 255/458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:03 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:03.539107 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:03.540038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:03.547454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.547838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.548711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.549188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.770463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2ac13c36-94a1-482b-a7d7-c99a40ce9794 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 25542 microversion: 2.20 time: 0.234546 May 13 16:26:03.771161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 256/459] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:03 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 25542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:03.777449 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:03.778167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:03.786541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.787057 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.787863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:03.788307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:03.993659 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:04.002356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-95d636bf-43bc-41bd-87b0-946c73748474 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.229851 May 13 16:26:04.002983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 257/460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:03 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:04.182145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:04.183277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:04.190564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.191017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.191831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.192267 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.453369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:04.462004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1e7ececc-cd1c-4f06-970e-b83f105cef9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.283611 May 13 16:26:04.462559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 258/461] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:04 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:04.549649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:04.550214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:04.557973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.561172 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.561172 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.561172 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.598417 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-40134f54-7f53-47fe-b4d0-4ff02b07c965 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.478748 May 13 16:26:04.599227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 204/462] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:26:03 2021] POST /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments => generated 194 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:26:04.768333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:04.777799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9c4d55dd-b09c-4805-8e0d-1e382bbdccf2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.231895 May 13 16:26:04.778391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 259/463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:04 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:04.783467 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:04.784540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:04.793010 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.793503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.794297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:04.794744 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:04.968152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-41e76311-7015-4d58-9c9e-a697d2eb9e01 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 26531 microversion: 2.20 time: 0.188723 May 13 16:26:04.968900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 205/464] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:04 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 26531 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:05.021859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:05.022608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:05.030519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.030978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.031763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.032211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.230563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:05.238819 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c1cd4b10-69f5-4272-bc0e-e14ec23fe759 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.220651 May 13 16:26:05.239391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 260/465] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:05 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:05.481235 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:05.481912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:05.489756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.490215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.491002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.491448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.694411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:05.703374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8f390b67-ac60-408d-bc8c-dd5d9d9dc9fa tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.227449 May 13 16:26:05.703899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 206/466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:05 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:05.795247 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:05.795868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:05.803275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.803730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.804514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.804961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.980838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:05.982001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:05.989462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.989999 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:05.990861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:05.991455 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.000041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:06.008253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de22354e-c74d-491e-9e2d-2a2497fcc0dd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.217327 May 13 16:26:06.009268 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 261/467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:05 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:06.196177 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3ae4caac-0148-4d86-8e6d-29364685b88e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 27072 microversion: 2.20 time: 0.219774 May 13 16:26:06.196818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 207/468] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:05 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 27072 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:06.223023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-eb0479b4-03dd-49cc-b8f1-453ed0b41a8a req-d7ac0c8b-d73a-4cf0-95b7-843b430d9128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35323dd5-d080-4384-8f73-f3735139fa97", "name": "network-vif-plugged", "status": "completed", "tag": "59cab5c3-bb3f-467c-bdcc-d3191ffd2f54"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:06.225041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:26:06.225041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:26:06.233968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-eb0479b4-03dd-49cc-b8f1-453ed0b41a8a req-d7ac0c8b-d73a-4cf0-95b7-843b430d9128 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:06.234596 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-eb0479b4-03dd-49cc-b8f1-453ed0b41a8a req-d7ac0c8b-d73a-4cf0-95b7-843b430d9128 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.252578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-eb0479b4-03dd-49cc-b8f1-453ed0b41a8a req-d7ac0c8b-d73a-4cf0-95b7-843b430d9128 service nova] Creating event network-vif-plugged:59cab5c3-bb3f-467c-bdcc-d3191ffd2f54 for instance 35323dd5-d080-4384-8f73-f3735139fa97 on hv-cinder-68948 May 13 16:26:06.257514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:06.257750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-eb0479b4-03dd-49cc-b8f1-453ed0b41a8a req-d7ac0c8b-d73a-4cf0-95b7-843b430d9128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 May 13 16:26:06.258231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:06.258370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 262/469] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:26:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:26:06.267860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:06.268341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.272821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:06.272821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.512052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:06.521048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-45ef9b8f-3ae3-461b-8fb4-f5103ed0529b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.268214 May 13 16:26:06.521892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 208/470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:06 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:06.721329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:06.722643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:06.731598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:06.732190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.734722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:06.734722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:06.996264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:07.005695 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-baa7b8b2-dc58-459f-a43b-6ef194ba8f5a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.289244 May 13 16:26:07.006278 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 263/471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:06 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:07.025285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:07.025849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:07.033394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.033873 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.034687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.035155 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.207931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:07.208882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:07.216846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.217319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.218079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.218517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.242567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:07.252750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e9b0cc39-a0d7-419f-9242-635502552bfa tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.231348 May 13 16:26:07.253927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 209/472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:07 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:07.546604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:07.547160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:07.555094 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.555564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.556366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:07.556815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:07.761681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:07.772293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e2566870-3b5b-425e-890f-dcd75cbc76fa tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.230112 May 13 16:26:07.772882 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 210/473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:07 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:08.023250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:08.024001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:08.031976 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.032613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:08.033332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.033807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:08.236753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:08.245531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-db690950-ca9f-4fae-a126-e8efa80a33bd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.225997 May 13 16:26:08.246101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 211/474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:08 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:08.269483 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:08.270109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:08.278071 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.278524 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:08.279304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.279743 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:08.478214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:08.486847 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4d7217cd-618a-4600-834a-ba09b43b2138 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.220895 May 13 16:26:08.487531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 212/475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:08 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:08.792759 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:08.793348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:08.800741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.801239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:08.802037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:08.802485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:09.006231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:09.016057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-951105ed-1016-4031-a8e9-1e3efe1977e4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.229408 May 13 16:26:09.016847 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 213/476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:08 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:09.262719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:09.263366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:09.270985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:09.271436 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:09.272227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:09.272661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:09.484049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:09.493391 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9eb50434-c0bc-40ac-87be-b0af32b0ff30 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.234367 May 13 16:26:09.494270 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 214/477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:09 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:09.510353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:09.511178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:09.519488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:09.520095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:09.521011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:09.521602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:09.731899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:09.740084 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-327dc703-5ca4-462f-9c11-4382aec5c3b9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.233620 May 13 16:26:09.740706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 215/478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:09 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:10.033059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:10.033687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:10.040895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.041381 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.042163 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.042598 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.324597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:10.332769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-adfb2183-504d-4cb8-93e0-442e4842d23b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.303437 May 13 16:26:10.333372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 216/479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:10 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:10.511492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:10.512153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:10.519505 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.519953 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.520753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.521217 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.722202 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:10.731668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b5222678-6d03-476b-ad98-155274a28193 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.224650 May 13 16:26:10.732226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 217/480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:10 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:10.756490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:10.757164 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:10.764249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.764698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.765509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:10.765948 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:10.961685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:10.970536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a387ef7c-a616-46b2-a059-87e7bd6b4e80 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.217357 May 13 16:26:10.971129 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 218/481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:10 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:11.349726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:11.350437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:11.358515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.358974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:11.359751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.360196 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:11.559647 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:11.567996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9409f6fa-b41c-4055-b907-3b66500bf898 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.222004 May 13 16:26:11.568570 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 219/482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:11 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:11.658226 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-92173664-0d02-420d-8047-3f5de8a777a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28443 microversion: 2.20 time: 4.453987 May 13 16:26:11.662243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 264/483] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:07 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28443 bytes in 4456 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:11.749356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:11.749982 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:11.757452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.757909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:11.758701 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.759142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:11.969412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:11.978412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e03ecd84-d7f8-4e49-93be-a0f59b556bb6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.233341 May 13 16:26:11.978988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 220/484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:11 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:11.988178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:11.988891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:11.997489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.997954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:11.998762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:11.999206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:12.214467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:12.232778 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5efb997d-7bfa-4081-af27-dd3532f3b53e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.248519 May 13 16:26:12.234051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 265/485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:11 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:12.584529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:12.585275 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:12.593320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:12.593786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:12.594624 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:12.595068 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:12.671783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:12.672902 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:12.680910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:12.681419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:12.682219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:12.682694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:12.808188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:12.816349 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5916681b-7b82-4ea0-be3d-ec23f164055d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.235724 May 13 16:26:12.816914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 221/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:12 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:12.966159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-09428c65-3f63-4ece-bf19-bec8c1ecbd3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28571 microversion: 2.20 time: 0.297991 May 13 16:26:12.966838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 266/487] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:12 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28571 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:12.995573 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:12.996184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:13.003413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.003975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.004766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.005233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.217323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:13.226313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0e84ef86-2bf9-4024-90bb-614911f2efd2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.234371 May 13 16:26:13.226930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 222/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:12 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:13.250693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:13.251407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:13.259671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.260135 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.260963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.261448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.468780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:13.477310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df0610bb-7f49-4c28-8efe-1a558189c21d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1313 microversion: 2.1 time: 0.230691 May 13 16:26:13.477893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 267/489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:13 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:13.833887 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:13.834514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:13.843182 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.843642 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.844469 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.844916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.978066 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:13.978991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:13.986863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.987245 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:13.988064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:13.988512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:14.079719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:14.088259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a8d4e4dc-42f5-462c-b897-e5cfb7801ea8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.258984 May 13 16:26:14.092093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 223/490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:13 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:14.221206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a3b1133e-a02f-4fb0-b275-dc679f274df8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28760 microversion: 2.20 time: 0.246809 May 13 16:26:14.221859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 268/491] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:13 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28760 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:14.243707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:14.244262 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:14.252118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:14.256665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:14.256665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:14.256665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:14.458181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:14.467863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a422a72d-4e6b-4e5c-a77d-f678433123ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.227872 May 13 16:26:14.468518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 224/492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:14 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:14.496088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:14.496746 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:14.505717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:14.506577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:14.506997 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:14.507735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:14.775328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:14.784332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ccbc1c14-ccce-4b50-8551-a8571605df27 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1495 microversion: 2.1 time: 0.293126 May 13 16:26:14.785264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 269/493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:14 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1495 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:15.108857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:15.110104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:15.118522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.118955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.119922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.120517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.232960 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:15.233934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:15.241524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.241982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.242782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.243412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.366236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:15.377794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-43563277-79ee-443e-a81f-46ddbda32603 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.274251 May 13 16:26:15.381151 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 225/494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:15 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:15.480220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-25ab3f9f-0d60-4a63-93cd-b569111e5637 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28994 microversion: 2.20 time: 0.251203 May 13 16:26:15.481313 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 270/495] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:15 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28994 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:15.485719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:15.486426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:15.494362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.499021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.499021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:15.499021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:15.742563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:15.753834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b72f6a4c-6154-4be6-b34b-d2cc780ca712 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.272464 May 13 16:26:15.757626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 226/496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:15 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:16.396519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:16.397157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:16.405612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.406076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.406847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.407290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.492930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:16.493974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:16.501397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.501854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.502636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.503099 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.629805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:16.639495 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-34863dce-3e3f-4c6b-8646-a75d5a4fc4de tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.247247 May 13 16:26:16.640418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 271/497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:16 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:16.771605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:16.772229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:16.781523 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.785602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.785602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.785602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.917308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-20589fd8-60f9-4d2b-a4fb-88de58288844 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28994 microversion: 2.20 time: 0.426305 May 13 16:26:16.918444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 227/498] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:16 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28994 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:16.942690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:16.943287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:16.951927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.952393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.953212 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:16.953659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:16.987282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:16.996896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b55c2b76-d6d0-49af-bb87-b76d9c80e1d5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.228942 May 13 16:26:16.997751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 272/499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:16 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:17.018651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:26:17.468524 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e67b62f4-8f6a-4d41-89bf-7e7f6d80bdba tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "DELETE /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 204 len: 0 microversion: 2.1 time: 0.529693 May 13 16:26:17.469152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 228/500] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:26:16 2021] DELETE /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 16:26:17.477547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:17.478162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:17.486303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.486764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:17.487674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.488119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:17.662176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:17.662883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:17.682691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.683188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:17.684003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.684450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:17.700333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:17.715214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-12391889-cdfa-4c4b-add7-f23a92a0e5e1 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1501 microversion: 2.1 time: 0.241707 May 13 16:26:17.715841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 273/501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:17 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:17.908699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:17.917993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a9d96383-88a8-46c4-945f-745ed5e907f6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.260069 May 13 16:26:17.927659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 229/502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:17 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:17.930077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:17.931129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:17.938273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.938834 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:17.939618 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:17.940053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.015886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:18.016429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:18.024770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.025267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.026119 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.026681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.130150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-527f7afb-614a-40b1-84a5-091312ad0275 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28994 microversion: 2.20 time: 0.203674 May 13 16:26:18.134028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 274/503] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:17 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28994 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:18.228258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:18.238268 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-44352c75-d40b-41d0-b920-ff4d92adb0d4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.226164 May 13 16:26:18.238850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 230/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:18 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:18.733672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:18.734386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:18.742544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.742993 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.743793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.744314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.936331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:18.936978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:18.944459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.945955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.946800 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:18.947253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:18.948491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:18.957491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-341c7c75-5e43-49b5-913b-78c3ce716a94 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1501 microversion: 2.1 time: 0.228518 May 13 16:26:18.958077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 275/505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:18 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:19.144063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:19.145205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:19.153678 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.154470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:19.155450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.156257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:19.166665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:19.176930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ae220949-2b4a-4865-ba5c-3b0d1a9098fe tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.245076 May 13 16:26:19.178004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 231/506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:18 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:19.255722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:19.258245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:19.264341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.264790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:19.265607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.266043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:19.373810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-613f90b1-c79a-4144-8fa9-c5992471a955 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28994 microversion: 2.20 time: 0.234214 May 13 16:26:19.376106 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 276/507] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:19 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28994 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:19.497264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:19.505994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0397d77d-4e53-4c7b-a229-3850a9a5c883 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.253971 May 13 16:26:19.506808 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 232/508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:19 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:19.976809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:19.977548 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:19.986030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.986489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:19.987285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:19.987729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.194763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:20.195505 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:20.204651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.205302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.206266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.206814 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.221778 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:20.231093 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d3c3f605-d14b-4a2e-812f-2fa7e02fa78a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1501 microversion: 2.1 time: 0.258806 May 13 16:26:20.233815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 277/509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:19 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:20.388628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:20.389578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:20.397489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.397866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.398669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.399110 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.504922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:20.524518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1c4fb3dc-0c12-4303-85f2-3428d7bc3a1b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.333197 May 13 16:26:20.527656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 233/510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:20 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:20.538571 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:20.540067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:20.574997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.575643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.576876 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:20.577565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:20.622022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f19a583c-986f-4cf1-bee9-d39314b64dc3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 28994 microversion: 2.20 time: 0.236577 May 13 16:26:20.625140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 278/511] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:20 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 28994 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:20.803150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:20.812371 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b4e29fc1-8693-484a-a377-942e5906c8e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.282799 May 13 16:26:20.812933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 234/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:20 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:21.254460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:21.255129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:21.265160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.265656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.266448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.266891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.471277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:21.480450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-eaabc18c-ca58-435d-9cd0-8834190624c0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1501 microversion: 2.1 time: 0.230318 May 13 16:26:21.481022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 279/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:21 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:21.544635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:21.545479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:21.552869 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.553352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.554147 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.554586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.633294 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:21.634405 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:21.641984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.642805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.643252 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.643773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.754555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:21.762825 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-378e1fee-c72b-491e-901e-cda305ab9ae8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.222726 May 13 16:26:21.763397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 235/514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:21 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:21.829013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:21.829670 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:21.836916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.837413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.838705 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:21.839157 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:21.981166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b1ed6336-2631-4e34-a081-2ecfbea71c1c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29283 microversion: 2.20 time: 0.351312 May 13 16:26:21.981933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 280/515] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:21 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29283 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:22.044345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:22.053242 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-47f2e040-d96d-469e-9ea1-13d19e802aff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1723 microversion: 2.1 time: 0.227738 May 13 16:26:22.053838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 236/516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:21 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:22.498111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:22.498824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:22.520610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:22.521271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:22.521897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:22.522338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:22.780123 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:22.780967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:22.788843 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:22.789407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:22.790207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:22.790667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:22.895675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:22.905871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-11a86be5-8e32-49eb-b55a-12fd78fca72a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1501 microversion: 2.1 time: 0.412375 May 13 16:26:22.917369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 281/517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:22 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1501 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:22.964346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-7fa04fd1-34de-4775-88c1-65ca24701d31 req-8ac90d1f-8cd8-4753-97eb-d672dbdbbe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35323dd5-d080-4384-8f73-f3735139fa97", "name": "network-vif-deleted", "tag": "59cab5c3-bb3f-467c-bdcc-d3191ffd2f54"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:22.966530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:26:22.966530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:26:22.983113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-7fa04fd1-34de-4775-88c1-65ca24701d31 req-8ac90d1f-8cd8-4753-97eb-d672dbdbbe35 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:22.983649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-7fa04fd1-34de-4775-88c1-65ca24701d31 req-8ac90d1f-8cd8-4753-97eb-d672dbdbbe35 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.001644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-7fa04fd1-34de-4775-88c1-65ca24701d31 req-8ac90d1f-8cd8-4753-97eb-d672dbdbbe35 service nova] Creating event network-vif-deleted:59cab5c3-bb3f-467c-bdcc-d3191ffd2f54 for instance 35323dd5-d080-4384-8f73-f3735139fa97 on hv-cinder-68948 May 13 16:26:23.007134 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-7fa04fd1-34de-4775-88c1-65ca24701d31 req-8ac90d1f-8cd8-4753-97eb-d672dbdbbe35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047668 May 13 16:26:23.008400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 282/518] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:26:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:26:23.014435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:23.015676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:23.023292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.023758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.024586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.025030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.042285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:23.051238 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5487b73b-14d6-4c0d-9b4e-e2428bb34cf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.275250 May 13 16:26:23.051925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 237/519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:22 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:23.070031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:23.077473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:23.078378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.078838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.079626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.080078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.282105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:23.291197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3013ed84-3c3b-42df-8303-98aa1f7842f5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1700 microversion: 2.1 time: 0.224652 May 13 16:26:23.292348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 238/520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:23 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1700 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:23.307856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8d5b7f6e-2661-4b8e-96e8-835147fd4476 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:23.315092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8d5b7f6e-2661-4b8e-96e8-835147fd4476 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.315556 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8d5b7f6e-2661-4b8e-96e8-835147fd4476 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.374875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8d5b7f6e-2661-4b8e-96e8-835147fd4476 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Going to try to start instance {{(pid=93649) start /opt/stack/nova/nova/compute/api.py:2602}} May 13 16:26:23.444875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b661b5d5-2bd9-4100-902d-42ab237753d9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29283 microversion: 2.20 time: 0.434712 May 13 16:26:23.445564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 283/521] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:23 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29283 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:23.591836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8d5b7f6e-2661-4b8e-96e8-835147fd4476 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 202 len: 0 microversion: 2.1 time: 0.287333 May 13 16:26:23.598883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 239/522] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:26:23 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:23.601014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:23.601748 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:23.610166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.610661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.611458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.612081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.825388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:23.831124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c4037cbb-ea83-42cf-88d8-4984c88fb101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.234136 May 13 16:26:23.832009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 284/523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:23 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:23.925768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:23.926484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:23.934476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.934939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:23.935731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:23.936176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.008247 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.008708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.009220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lazy-loading 'fault' on Instance uuid 35323dd5-d080-4384-8f73-f3735139fa97 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:26:24.071194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:24.073214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:24.074242 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.079486 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4719136e-e69a-471e-b713-f6512d9f7247 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1303 microversion: 2.1 time: 0.157763 May 13 16:26:24.080597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 240/524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:23 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:24.082856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.083461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.084419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.084970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.373150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:24.381954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5651018c-e430-4934-aa85-07b434549803 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1500 microversion: 2.1 time: 0.317463 May 13 16:26:24.383178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 285/525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:24 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:24.400054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "521cf066-5ec1-407b-a15f-28f4ef4e21c0"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:24.402012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.409879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.410340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.411247 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.411725 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.457255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:24.458600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.468883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.469632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.470292 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] HTTP exception thrown: Cannot 'attach_volume' instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 while it is in vm_state rescued May 13 16:26:24.470894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.471006 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Returning 409 to user: Cannot 'attach_volume' instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 while it is in vm_state rescued {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:26:24.471740 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-49d6b5d7-bc77-4c30-aa2c-ce2edb85fb71 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076363 May 13 16:26:24.471866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.475668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 241/526] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:26:24 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 16:26:24.481961 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:24.482578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.493899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.495234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.496113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.496633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.724471 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7440943d-4b2c-40ce-969a-eaf78e9e2c4f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29283 microversion: 2.20 time: 0.270757 May 13 16:26:24.726450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 286/527] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:24 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29283 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:24.797399 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1a142799-cf86-44d2-8ceb-104e6bb2d1ae tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action" status: 202 len: 0 microversion: 2.1 time: 0.320157 May 13 16:26:24.801018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 242/528] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:26:24 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:24.807499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:24.808307 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.824529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.825111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.826000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.826491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.857851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:24.857851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:24.859015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.859484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:24.860309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:24.860900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:25.168826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:25.178879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-31a72c5f-88b3-4630-a88e-797018fcbfcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.333333 May 13 16:26:25.189523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 243/529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:24 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:25.194548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:25.195569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:25.203535 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:25.204326 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:25.205405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:25.206339 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:25.208321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:25.218261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3c864967-b4d4-41a7-b3c7-1a7134b77b2e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.415475 May 13 16:26:25.222030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 287/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:24 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:25.288317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:25.288774 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:25.289266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lazy-loading 'fault' on Instance uuid 35323dd5-d080-4384-8f73-f3735139fa97 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:26:25.363099 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:25.377333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-763ffbfd-ba59-44c6-a67a-54e56f57ecdf tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 200 len: 1303 microversion: 2.1 time: 0.185673 May 13 16:26:25.378695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 244/531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:25 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:25.741534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:25.743242 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:25.752207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:25.753005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:25.754050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:25.754567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.029063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-34fe502b-6a9f-4edc-bbf7-70bebe6b0743 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.293627 May 13 16:26:26.030981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 288/532] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:25 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:26.197285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:26.198021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:26.205314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.205772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.206567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.207017 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.240260 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:26.241141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:26.249404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.249857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.250641 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.251076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.409968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:26.419079 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fe822cd9-abf6-4840-8d7f-6ca5c226549e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.225819 May 13 16:26:26.419657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 245/533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:26 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:26.423909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:26.424528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: 35323dd5-d080-4384-8f73-f3735139fa97] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:26.431969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.432421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.433229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:26.436495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:26.455821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:26.466531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df0edb3d-c9a9-4f4b-b899-badc9eb80fec tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.230491 May 13 16:26:26.467241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 289/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:26 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:26.484453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] HTTP exception thrown: Instance 35323dd5-d080-4384-8f73-f3735139fa97 could not be found. May 13 16:26:26.485067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Returning 404 to user: Instance 35323dd5-d080-4384-8f73-f3735139fa97 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:26:26.485930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-12cf5ec2-3fb8-4c00-90ce-f03fe33efc40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97" status: 404 len: 111 microversion: 2.1 time: 0.065338 May 13 16:26:26.486478 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 246/535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:26 2021] GET /compute/v2.1/servers/35323dd5-d080-4384-8f73-f3735139fa97 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:26:26.597846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-370104386", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "6e369916-a5a7-4b77-95bf-81af0f82aa4a"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:26.669202 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] validate_networks() for [('6e369916-a5a7-4b77-95bf-81af0f82aa4a', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:26:27.041366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:27.042347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:27.049836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.050395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.051302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.051572 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.315129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:26:27.315619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:26:27.316028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:26:27.316444 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:26:27.316893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:26:27.325499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.325951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.326791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.327233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.344517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Getting quotas for project e0bc2aa4ccfb477ebc03dad77a3f3273. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:26:27.348557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Getting quotas for user 582d073338bb45e7a0fd76b4a662cf32 and project e0bc2aa4ccfb477ebc03dad77a3f3273. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:26:27.359683 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:26:27.362099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:26:27.578653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-46bbdce0-7f12-4311-a728-e8639b2b50f5 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984523 May 13 16:26:27.582331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 290/536] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:26:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:26:27.583793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:27.584723 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:27.592783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.593302 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.594087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.594528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.795877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:27.804515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0e95d25b-831a-4c99-bdd0-9dafce8f9329 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.224265 May 13 16:26:27.805102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 291/537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:27 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:27.809490 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:27.810099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:27.817374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.817837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:27.818710 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:27.819088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:28.017525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:28.026421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c3e6593a-09a8-42c8-b18b-5f822f0b0cd7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.219790 May 13 16:26:28.026987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 292/538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:27 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:28.031731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fd6cb24a-2da2-4fd9-8f6e-a1597719e300 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:28.032342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fd6cb24a-2da2-4fd9-8f6e-a1597719e300 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:28.102338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-fd6cb24a-2da2-4fd9-8f6e-a1597719e300 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:28.110408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fd6cb24a-2da2-4fd9-8f6e-a1597719e300 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1213 microversion: 2.1 time: 0.082403 May 13 16:26:28.111097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 293/539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:28 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:28.821455 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:28.822072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:28.829843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:28.830300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:28.831070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:28.831505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:29.034398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:29.044612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-eed4aa4f-359b-43dc-9d5b-1baa00be534d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.227079 May 13 16:26:29.045218 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 294/540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:28 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:29.049648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:29.050264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:29.057456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:29.057920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:29.058735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:29.059163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:29.264575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:29.273205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7a6fb904-ca40-4ced-9a06-f0592969ed51 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.226953 May 13 16:26:29.273882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 295/541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:29 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:29.278809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:29.279506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:29.287190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:29.287663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:29.288482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:29.288911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:29.401482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:29.409793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c2dfdf21-817f-4935-a6d9-5149d5ff3f5f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1217 microversion: 2.1 time: 0.134861 May 13 16:26:29.410360 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 296/542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:29 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:30.062528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:30.063195 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:30.070742 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.071211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.072033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.073180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.279073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:30.284808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-aecf3e00-c4b0-4e09-9c3c-cf4772124bd4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1709 microversion: 2.1 time: 0.226684 May 13 16:26:30.285999 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 297/543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:30 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1709 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:30.290246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:30.290841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:30.298450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.298911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.299708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.300157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.497115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:30.505664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-34c221d4-88a0-4e26-a11d-75e581c9fdf4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.218991 May 13 16:26:30.506253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 298/544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:30 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:30.510735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:30.511350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:30.518786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.519243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.520050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:30.520494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:30.636548 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:30.644823 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b21b26e4-5fe4-476d-bdb6-c29fea09c773 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1217 microversion: 2.1 time: 0.137589 May 13 16:26:30.645424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 299/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:30 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:30.944296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3377ffe3-567f-430a-b995-2cff44a33479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 3.906531 May 13 16:26:30.944854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 247/546] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:27 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 3908 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:31.302925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:31.303534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:31.312399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.312930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.313807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.314332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.523560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:31.524663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:31.533281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.534118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.536770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.536770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.581292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:31.591646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dab3c9b1-aac6-4b39-bec1-96d34a23801a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1713 microversion: 2.1 time: 0.292868 May 13 16:26:31.592333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 300/547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:31 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1713 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:31.664337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:31.665154 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:31.678257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.678875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.680645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.681124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.803105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:31.813570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-148d8f7b-a89c-4f43-9376-760b96e70330 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1265 microversion: 2.1 time: 0.154749 May 13 16:26:31.814162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 301/548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:31 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:31.836971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:31.845353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-735b0fce-cad2-47cb-9998-a815c11a5227 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.325933 May 13 16:26:31.845920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 248/549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:31 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:31.956379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:31.957386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:31.964754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.965243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:31.966062 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:31.966507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:32.393752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2a710b97-6827-4b2e-9c53-af56357bb176 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.440972 May 13 16:26:32.394506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 302/550] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:31 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:32.830757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:32.831363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:32.839464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:32.839924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:32.840748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:32.841228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:32.863502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:32.864206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:32.885825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:32.886468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:32.887424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:32.887947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:32.963005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:32.971648 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dec589c2-3423-4b52-b232-189776bf85ab tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1265 microversion: 2.1 time: 0.144598 May 13 16:26:32.972410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 249/551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:32 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:33.090808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:33.099152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c4f3cef1-921a-45c2-824e-85c227fd3d60 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.240044 May 13 16:26:33.099743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 303/552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:32 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:33.405209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:33.406185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:33.416925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:33.417410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:33.418203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:33.418659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:33.614259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-06f2565d-091c-47ab-afdd-34885b819a71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.212517 May 13 16:26:33.618854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 250/553] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:33 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:33.988912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:33.989737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:33.997892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:33.998446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:33.999339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:33.999856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.116514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:34.116690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:34.117559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:34.125355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ab52774f-bff7-41d6-9fe0-2e580720734f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1271 microversion: 2.1 time: 0.140058 May 13 16:26:34.125764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.126379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 304/554] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:33 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:34.126529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.127050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.127493 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.431018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:34.439892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-94ec153b-022b-425e-809b-e5d55e0c169e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.327686 May 13 16:26:34.440476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 251/555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:34 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:34.626414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:34.627334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:34.635134 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.635134 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.636231 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.636588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.820824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4330714-086f-47bf-9838-04ea91de6f1c"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:34.821963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:34.830633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.831092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.831880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:34.832323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:34.989717 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Invalid volume: volume a4330714-086f-47bf-9838-04ea91de6f1c is already attached to instances: 9953c737-dccb-4150-a5e9-6717bbb4d2b8 May 13 16:26:34.990343 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 400 to user: Invalid volume: volume a4330714-086f-47bf-9838-04ea91de6f1c is already attached to instances: 9953c737-dccb-4150-a5e9-6717bbb4d2b8 {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:26:34.991173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-74698922-617d-46ec-8dbf-c3fb4e048263 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174419 May 13 16:26:34.991723 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 252/556] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:26:34 2021] POST /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 16:26:35.093686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:35.094197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:35.101653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.102132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:35.102946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.103411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:35.265029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'services' on Instance uuid 9953c737-dccb-4150-a5e9-6717bbb4d2b8 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:26:35.644364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-59d86c56-be09-4160-b591-7b44bf1ece39 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments/a4330714-086f-47bf-9838-04ea91de6f1c" status: 202 len: 0 microversion: 2.1 time: 0.554286 May 13 16:26:35.644957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 253/557] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:26:35 2021] DELETE /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8/os-volume_attachments/a4330714-086f-47bf-9838-04ea91de6f1c => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:35.649898 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:35.656391 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:35.658857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.659324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:35.660107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.660549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:35.941656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:35.950757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-df7fa6df-1033-4db5-b0b5-2675a8f6e95b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.304626 May 13 16:26:35.951321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 254/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:35 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:35.955721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:35.956329 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:35.963579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.964030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:35.964807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:35.965279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:36.163492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:36.172810 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-52cec685-c196-4ead-83f7-dfa07028b8ba tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.220481 May 13 16:26:36.173438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 255/559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:35 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:36.968385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:36.969106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:36.976684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:36.977169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:36.977970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:36.978871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:37.089016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0777190a-b825-461e-915d-a21ca007c856 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 2.465469 May 13 16:26:37.089731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 305/560] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:34 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:37.190473 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:37.191211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:37.219408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:37.222830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:37.222830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:37.222830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:37.408128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:37.420669 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-261e1e23-4aad-4f7c-8d95-35c85f0ea6f2 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.455929 May 13 16:26:37.422042 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 256/561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:36 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:37.440422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:37.450764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-53c398a8-176f-46e0-ad78-81ae8f9bdf5a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.264410 May 13 16:26:37.451886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 306/562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:37 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:38.114667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:38.114667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:38.119366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.120818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.121870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.122542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.375270 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-26fba398-72ce-48d5-b442-a8e97bd012df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.278719 May 13 16:26:38.375878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 257/563] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:38 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:38.438272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:38.438804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:38.446737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.447188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.448039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.448497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.469598 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:38.470482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:38.479773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.480399 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.481358 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.481921 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.732176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:38.743500 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d89b478e-9ac6-4e93-b488-40a452f5331b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.308078 May 13 16:26:38.752541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 307/564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:38 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:38.752541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-6612dfc1-dc10-4442-8547-725081c6d7f2 req-3d595029-cefd-4ec4-84e5-3750ed70245d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad82bd9-50e6-4d3b-9c13-d2a9afce29be", "tag": "3820e178-e1c9-4746-af52-39c0452d5c19"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:38.752541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:26:38.752541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:26:38.763138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6612dfc1-dc10-4442-8547-725081c6d7f2 req-3d595029-cefd-4ec4-84e5-3750ed70245d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:38.763592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6612dfc1-dc10-4442-8547-725081c6d7f2 req-3d595029-cefd-4ec4-84e5-3750ed70245d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:38.780761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-6612dfc1-dc10-4442-8547-725081c6d7f2 req-3d595029-cefd-4ec4-84e5-3750ed70245d service nova] Creating event network-changed:3820e178-e1c9-4746-af52-39c0452d5c19 for instance fad82bd9-50e6-4d3b-9c13-d2a9afce29be on hv-cinder-68948 May 13 16:26:38.785875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-6612dfc1-dc10-4442-8547-725081c6d7f2 req-3d595029-cefd-4ec4-84e5-3750ed70245d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039826 May 13 16:26:38.786828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 308/565] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:26:38.792853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:38.801113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c21a4462-a8d9-46b3-9443-3ab44905ed36 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1508 microversion: 2.1 time: 0.335729 May 13 16:26:38.801957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 258/566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:38 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:39.388517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:39.389606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:39.397405 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.397871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.398665 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.399114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.580581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8bb898d6-807d-461c-b832-48ecf5b38db2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.196722 May 13 16:26:39.581399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 309/567] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:39 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:39.760115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:39.760760 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:39.768595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.769056 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.769878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.770320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.818949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:39.819595 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:39.828190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.828653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.829642 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:39.830006 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:39.975873 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:39.985213 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2c17f883-6a57-4a8f-b09d-acce8c7c7abb tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.228815 May 13 16:26:39.985896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 259/568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:39 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:40.038070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:40.049560 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-603427d6-f224-43cc-aa38-ce464a6ce333 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1514 microversion: 2.1 time: 0.234822 May 13 16:26:40.050141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 310/569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:39 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:40.769912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:40.769912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:40.769912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:40.769912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:40.770770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:40.770770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:41.002553 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:41.003180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:41.011206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:41.011662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:41.012451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:41.012891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:41.224587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:41.234935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-12c627ba-54b5-4cd6-b58a-ca2d130caef9 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.235857 May 13 16:26:41.235804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 311/570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:40 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:42.252316 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:42.253038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:42.261116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:42.261591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:42.262415 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:42.262913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:42.528983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:42.537227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4cfdfbbc-3c5e-403d-a65a-ed11c992436d tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.288719 May 13 16:26:42.537811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 312/571] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:42 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:42.543343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:26:42.543497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:26:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:26:43.410933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a147d8ab-4fed-4e81-be8f-523ba90d5fe8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 2.822383 May 13 16:26:43.413060 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 260/572] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:40 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:43.555076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:43.555706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:43.564542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:43.565034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:43.565856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:43.566538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:43.787481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:43.796177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-77baffae-b52a-4e9f-a11d-cbcca1554f40 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.245321 May 13 16:26:43.796746 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 313/573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:43 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:44.424599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:44.425651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:44.433615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:44.434071 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:44.434859 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:44.435296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:44.606102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dbdf86d4-fb0e-4f22-9687-0fd44a90dbbc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.185760 May 13 16:26:44.608833 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 261/574] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:44 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:44.813150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:44.813773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:44.821359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:44.822950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:44.823284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:44.823724 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:45.031871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:45.040468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-653e7143-9c90-407a-8114-49a3843f5f19 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.231077 May 13 16:26:45.041074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 314/575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:44 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:45.622310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:45.625557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:45.638589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:45.639376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:45.640423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:45.641066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:45.714985 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-900132565", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "364f9ea7-bb68-4d81-80ce-70cec45c9d8c"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:45.780468 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] validate_networks() for [('364f9ea7-bb68-4d81-80ce-70cec45c9d8c', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:26:45.828078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b8350e24-d347-4fe5-951a-edcf80af4e60 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.213940 May 13 16:26:45.833028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 262/576] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:45 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:45.918528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:45.919243 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:45.927546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:45.928020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:45.928833 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:45.929312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.149495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:46.158840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2b552133-9e28-4e67-9b3e-08ac6732edb2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1514 microversion: 2.1 time: 0.245113 May 13 16:26:46.159689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 263/577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:45 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:46.176304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:46.176927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:46.184320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.184771 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.185776 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.186224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.348088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:26:46.348618 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:26:46.349005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:26:46.349491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:26:46.349895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:26:46.359215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.359670 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.360660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.361127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.379117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:26:46.383846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Getting quotas for user 4884755f5b1a48cb8e5ff82429a30a31 and project 3b851be948d64579ae17b2525d0e84b2. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:26:46.397026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:46.399083 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:26:46.402092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:26:46.405798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-575f708f-bae4-4d0c-b696-3a02fc7b00ca tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.233293 May 13 16:26:46.406377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 264/578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:46 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:46.410852 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f2e5b19-1a8b-4601-bb64-62c4f1c948bb"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:46.411905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:46.419002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.419653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.420491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.420948 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.618511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-25dc59d3-fdff-4b7d-b3f4-94065385ee3f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907766 May 13 16:26:46.619080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 315/579] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:26:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:26:46.629321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-667437ab-ca99-470e-8548-fbb496adda73 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:46.630045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-667437ab-ca99-470e-8548-fbb496adda73 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:46.709127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-667437ab-ca99-470e-8548-fbb496adda73 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:46.718389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-667437ab-ca99-470e-8548-fbb496adda73 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1217 microversion: 2.1 time: 0.092691 May 13 16:26:46.718961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 316/580] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:46 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:46.840104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:46.841116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:46.848762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.849285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:46.850102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:46.850567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:47.021787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dd17f737-07f0-4774-ada3-f760e77df2e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.185323 May 13 16:26:47.022489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 317/581] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:46 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:47.424140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:47.424785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:47.433655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:47.434113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:47.434904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:47.435387 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:47.657499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:47.665907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1360aa58-b4fa-44b5-be0e-af60ca0655b0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.246032 May 13 16:26:47.667236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 318/582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:47 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:47.735793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3ad0d9ef-82d6-464e-b7ff-46758e6db2c1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:47.736419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3ad0d9ef-82d6-464e-b7ff-46758e6db2c1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:47.769769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6207f5c8-c93d-4a8f-9a1b-78f521ea6b6f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.362052 May 13 16:26:47.770397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 265/583] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:26:46 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments => generated 194 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:26:47.810228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3ad0d9ef-82d6-464e-b7ff-46758e6db2c1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:47.818077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3ad0d9ef-82d6-464e-b7ff-46758e6db2c1 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1217 microversion: 2.1 time: 0.086143 May 13 16:26:47.818898 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 319/584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:47 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:48.035795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:48.039074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:48.046037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.046496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.047341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.047783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.266773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-74dbec63-d1e5-4218-bd97-e76fafebae15 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.236054 May 13 16:26:48.267530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 266/585] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:48 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:48.684037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:48.684571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:48.693030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.693531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.694344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.694796 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.837031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:48.838766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:48.846588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.847050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.847881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:48.848459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:48.904404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:48.921504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dba809cf-e4a2-4170-a990-1dbe37b63b92 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.241757 May 13 16:26:48.922195 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 320/586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:48 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:48.980302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:48.985699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c2f37633-a2b6-45b7-8682-58d9dd69f69c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1213 microversion: 2.1 time: 0.153283 May 13 16:26:48.986272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 267/587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:48 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:49.279752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:49.282637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:49.288706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.289189 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.289987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.290432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.469602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4537efab-89e5-4d65-91a9-fb33e5fe0bd2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.193958 May 13 16:26:49.470614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 321/588] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:49 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:49.520802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:49.521327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:49.529130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.530075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.530851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.531290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.698974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lazy-loading 'services' on Instance uuid c53c86b7-07d6-450d-8987-4ecaabb80bd2 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:26:49.938653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:49.939351 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:49.948243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.948706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.949539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:49.949978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:49.994246 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-367d889d-1f8c-4261-816a-47955d45a604 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2/os-volume_attachments/8cd7e99b-e986-4b1e-8a2c-8aceab1aee7a" status: 202 len: 0 microversion: 2.1 time: 0.477046 May 13 16:26:49.996815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 268/589] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:26:49 2021] DELETE /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2/os-volume_attachments/8cd7e99b-e986-4b1e-8a2c-8aceab1aee7a => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:26:50.006462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:50.007405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:50.017941 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:50.018616 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:50.019713 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:50.022822 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:50.288156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:50.301289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-96452340-f013-4636-a442-bb51ee748d0a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1277 microversion: 2.1 time: 0.300833 May 13 16:26:50.306023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 269/590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:49 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:50.306693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:50.319922 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-43516e0d-0863-4b50-8606-d294ee670ead tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.385357 May 13 16:26:50.320926 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 322/591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:49 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:50.481752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:50.482724 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:50.490164 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:50.490614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:50.491398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:50.491855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:50.681213 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cb9560eb-2d4d-497b-8800-5d426f7e2e86 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29449 microversion: 2.20 time: 0.203173 May 13 16:26:50.685536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 270/592] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:50 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29449 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:51.324210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:51.329522 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:51.334043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.334566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.337071 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.337071 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.343154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:51.343960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:51.352403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.352674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.354519 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.354994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.615198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:51.624284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-84b4d38c-1d35-4f90-bf48-be9900c12fd0 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.304776 May 13 16:26:51.625112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 323/593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:51 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:51.694680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:51.695314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:51.704129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.704577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.705389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:51.705896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:51.819626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:51.830315 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f346e9f3-af9d-414b-8e3d-6e8d1684575f tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.491093 May 13 16:26:51.831133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 271/594] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:51 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:51.898027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c08d66fd-2abf-448d-a871-6b711baa50d3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 29976 microversion: 2.20 time: 0.207245 May 13 16:26:51.902980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 324/595] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:51 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 29976 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:52.648628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:52.649986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:52.660365 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:52.660933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:52.661926 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:52.662438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:52.725044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-8649cedd-3dd6-462a-93b3-ea3b804e0d24 req-a961f73a-3977-43de-b0b2-36e3a9883ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590e1a04-937f-4d07-9cbf-41abae54cb76", "tag": "f7c06216-8f54-488d-a87b-b267aa1960d0"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:52.726693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:26:52.726693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:26:52.736846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-8649cedd-3dd6-462a-93b3-ea3b804e0d24 req-a961f73a-3977-43de-b0b2-36e3a9883ab0 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:52.737336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-8649cedd-3dd6-462a-93b3-ea3b804e0d24 req-a961f73a-3977-43de-b0b2-36e3a9883ab0 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:52.753466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-8649cedd-3dd6-462a-93b3-ea3b804e0d24 req-a961f73a-3977-43de-b0b2-36e3a9883ab0 service nova] Creating event network-changed:f7c06216-8f54-488d-a87b-b267aa1960d0 for instance 590e1a04-937f-4d07-9cbf-41abae54cb76 on hv-cinder-68948 May 13 16:26:52.758082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-8649cedd-3dd6-462a-93b3-ea3b804e0d24 req-a961f73a-3977-43de-b0b2-36e3a9883ab0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037158 May 13 16:26:52.758666 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 325/596] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:26:52.848218 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:52.849220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:52.857450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:52.857904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:52.858716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:52.859152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:52.974371 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:52.985135 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-15d577ef-ab3d-4b40-ab3e-1252122c18c5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.340936 May 13 16:26:52.985992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 272/597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:52 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:52.991635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:52.992786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:53.001344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:53.001889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:53.002959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:53.003474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:53.069884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:53.089011 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-50105065-3a9c-40ad-a281-a179426ec813 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.244841 May 13 16:26:53.090316 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 326/598] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:52 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:53.258958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8ef59263-5dd3-42c5-b327-1984c53d7b3e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 30644 microversion: 2.20 time: 0.271566 May 13 16:26:53.260346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 273/599] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:52 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 30644 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:53.408447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-09e15ec1-ad6b-408e-8e39-59fd0e928f50 req-ef85601c-9d00-47a6-bd0b-f4200904f867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad82bd9-50e6-4d3b-9c13-d2a9afce29be", "name": "network-vif-plugged", "status": "completed", "tag": "3820e178-e1c9-4746-af52-39c0452d5c19"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:53.409234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:26:53.409234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:26:53.419873 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-09e15ec1-ad6b-408e-8e39-59fd0e928f50 req-ef85601c-9d00-47a6-bd0b-f4200904f867 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:53.420601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-09e15ec1-ad6b-408e-8e39-59fd0e928f50 req-ef85601c-9d00-47a6-bd0b-f4200904f867 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:53.443528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-09e15ec1-ad6b-408e-8e39-59fd0e928f50 req-ef85601c-9d00-47a6-bd0b-f4200904f867 service nova] Creating event network-vif-plugged:3820e178-e1c9-4746-af52-39c0452d5c19 for instance fad82bd9-50e6-4d3b-9c13-d2a9afce29be on hv-cinder-68948 May 13 16:26:53.450294 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-09e15ec1-ad6b-408e-8e39-59fd0e928f50 req-ef85601c-9d00-47a6-bd0b-f4200904f867 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047572 May 13 16:26:53.451377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 327/600] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:26:54.004904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:54.005736 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:54.014769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.015256 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.016023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.016472 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.109272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:54.110116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:54.118613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.119795 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.121123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.121123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.408910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:54.417717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-71a13fd8-2de9-42d1-9374-908396e51349 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.313152 May 13 16:26:54.418290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 328/601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:54 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:54.422765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:54.423657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:54.431032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.431177 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:54.431527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.432312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:54.432748 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:54.439271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-98266840-4782-4f22-b0d2-4c4b4c85716e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.439920 May 13 16:26:54.439899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 274/602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:53 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:54.775080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a06a69f8-0ab5-4c1b-b76b-d4c4919bb8b6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 32211 microversion: 2.20 time: 0.352216 May 13 16:26:54.775080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 329/603] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:54 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 32211 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:55.435241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:55.436121 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:55.445374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.446033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:55.447001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.448189 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:55.456596 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:55.457450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:55.465848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.466327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:55.467321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.467769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:55.737681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:55.744051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:55.751728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a3ec2cb9-1a40-463e-b78c-6d1554184c4e tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.316745 May 13 16:26:55.755655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 275/604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:55 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:55.760089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-76a1d83b-cfa2-4a4d-8ff4-fbda22000ce5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.306972 May 13 16:26:55.761050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 330/605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:55 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:55.789241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:55.789241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:55.800305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.801011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:55.801853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:55.802334 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:56.030735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f6b266de-c75a-4830-950f-047fcbe5cc14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 32791 microversion: 2.20 time: 0.248674 May 13 16:26:56.031657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 276/606] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:55 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 32791 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:56.764326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:56.764937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:56.772802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:56.773315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:56.774178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:56.774632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:56.779236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:56.780172 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:56.788733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:56.789236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:56.790035 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:56.790484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:56.994894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:57.003243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:57.003421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8c5e47b1-90b6-4d58-8c8e-a4bf6adf3b1d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.229573 May 13 16:26:57.003974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 277/607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:56 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:57.013070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8483d3ae-fe90-4a98-ba1d-b101cc10dbbd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.253184 May 13 16:26:57.013895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 331/608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:56 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:57.043596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:57.044421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:57.051643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:57.052097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:57.052872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:57.053351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:57.414883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-73ed464f-765b-453d-8c47-811ec163367c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 33231 microversion: 2.20 time: 0.374935 May 13 16:26:57.415582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 278/609] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:57 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 33231 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:58.023798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:58.024445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:58.034211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:58.034211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:58.034714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.034714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.034914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.035263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.040309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.040712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.041531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.042021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.243161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:58.251950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fdce2d40-babc-4b37-be8c-ab8f941f6d2b tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.232096 May 13 16:26:58.252908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 332/610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:58 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:58.389973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:58.397977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7be4d6d6-57f4-4b14-8762-e0a7a96ce142 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.371553 May 13 16:26:58.398542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 279/611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:58 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:26:58.427386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:58.428295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:58.436766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.437259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.438036 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:58.438474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:58.644567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-599f0c62-f518-4262-83cb-54fcb2c1d3ad tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 33518 microversion: 2.20 time: 0.220983 May 13 16:26:58.645538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 333/612] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:58 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 33518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:26:58.742287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1273838283", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:58.804286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] validate_networks() for None {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:26:58.992358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:58.993415 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.001865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.002328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.003308 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.003544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.061334 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:26:59.062025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'flavor' on Instance uuid a5c7c299-cc4b-4299-b6af-e0b4e21580e4 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:26:59.062753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:26:59.063261 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:26:59.063684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:26:59.064106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:26:59.073005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.073495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.074541 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.075163 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.097176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Getting quotas for project d3a5f5dbc15743818dd43878ebad5a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:26:59.102536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Getting quotas for user 8184ac1443d74864b8ab494d65439f84 and project d3a5f5dbc15743818dd43878ebad5a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:26:59.115685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:26:59.118647 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:26:59.240891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-21484529-5ca4-4d5e-b71f-9aace3c1e399 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502039 May 13 16:26:59.249545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 280/613] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:26:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:26:59.254442 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c08f8934-97e3-4f07-8e62-77b7d2d02a9f tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:59.255228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c08f8934-97e3-4f07-8e62-77b7d2d02a9f tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.332911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c08f8934-97e3-4f07-8e62-77b7d2d02a9f tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:59.342301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c08f8934-97e3-4f07-8e62-77b7d2d02a9f tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1215 microversion: 2.1 time: 0.091550 May 13 16:26:59.343948 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 281/614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:59 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:59.352839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:59.353758 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.363030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.363484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.364325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.364769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.596083 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f3872bfe-4af5-4ae8-8655-ec1e6bb1d377 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action" status: 200 len: 32 microversion: 2.1 time: 0.607827 May 13 16:26:59.596971 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 334/615] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:26:58 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action => generated 32 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 16:26:59.603376 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:59.604265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.606757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:59.613063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.613541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.614423 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.614874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.616404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b81f7a1e-eaaf-4f5d-aede-5c6d659b89de tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.271266 May 13 16:26:59.617229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 282/616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:59 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:59.623643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:26:59.624630 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.634200 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.635250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.636737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.637606 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.915914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:26:59.928183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2c3773ff-680a-41f6-b58b-0e37a821845c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.309246 May 13 16:26:59.929252 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 283/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:59 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:26:59.934723 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:26:59.938734 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:26:59.946664 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.947145 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.947945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:26:59.948383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:26:59.994139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:00.004179 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fc2f5d45-551c-450b-88c7-6dbf5d57fd3b tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1313 microversion: 2.1 time: 0.405644 May 13 16:27:00.004766 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 335/618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:26:59 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:00.156790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e905b74a-ad81-47d2-bb15-656169593e88 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 33979 microversion: 2.20 time: 0.226126 May 13 16:27:00.160855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 284/619] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:26:59 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 33979 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:00.359383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-44de7a73-33c7-42ae-93eb-bf9ae90d9efe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:00.360716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-44de7a73-33c7-42ae-93eb-bf9ae90d9efe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:00.432542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-44de7a73-33c7-42ae-93eb-bf9ae90d9efe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:00.440321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-44de7a73-33c7-42ae-93eb-bf9ae90d9efe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1215 microversion: 2.1 time: 0.084599 May 13 16:27:00.441286 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 336/620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:00 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:00.638406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:00.639142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:00.648122 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:00.648498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:00.649321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:00.649757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:00.882675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:00.891880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4233789a-3827-41b1-b4b7-45b0f4ca4ce6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.258708 May 13 16:27:00.892530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 285/621] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:00 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:00.945532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:00.946235 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:00.954856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:00.955410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:00.956282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:00.956807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.021323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:01.021954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.030472 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.030929 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.031704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.032188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.157069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:01.167140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9eea32d9-ac65-4130-9ea8-a4cd653a2882 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.225226 May 13 16:27:01.167704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 337/622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:00 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:01.172626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:01.174414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.184563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.185674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.186994 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.187916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.258124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:01.267093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7364bf3a-c6f5-4e59-ba90-93fe042f4e8a tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1495 microversion: 2.1 time: 0.249629 May 13 16:27:01.267671 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 286/623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:01 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1495 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:01.343183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:01.343679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.351293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.351744 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.352520 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.353239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.362782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ae7d27fe-5d41-42fa-86d5-eeac9c58f35f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 34397 microversion: 2.20 time: 0.190489 May 13 16:27:01.362782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 338/624] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:01 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 34397 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:01.414854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:01.459577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:01.460662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.469862 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.470315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.471132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.471728 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.590687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:01.599196 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b9b3bc93-c506-4671-93ed-216a57dc9524 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1267 microversion: 2.1 time: 0.144990 May 13 16:27:01.599739 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 339/625] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:01 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:01.833356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-223a6fc5-cab8-4c30-97bf-c32bfd603c76 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 204 len: 0 microversion: 2.1 time: 0.493448 May 13 16:27:01.833946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 287/626] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:01 2021] DELETE /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 16:27:01.842098 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:01.843820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.850184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.850635 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.851402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.851838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.908467 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:01.909168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:01.916377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.916839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:01.918286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:01.918769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.058214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:02.066524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bd1a3f88-6edc-4361-a9af-bb21bd8ac6b0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1512 microversion: 2.1 time: 0.228161 May 13 16:27:02.067086 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 340/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:01 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:02.127103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:02.135363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c24db5e2-a36a-432d-80f8-31284b32a354 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.231271 May 13 16:27:02.135923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 288/628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:01 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:02.184174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:02.184796 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:02.192107 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.192564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.193372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.193817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.373933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:02.375490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:02.385169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.385862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.386993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.387709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.398722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:02.409674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2021e751-8a04-40c4-83fd-67d0269742c5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.229726 May 13 16:27:02.414749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 341/629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:02 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:02.588568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-39b79c34-a60b-4ba7-a32c-35e01b89e788 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 34818 microversion: 2.20 time: 0.220073 May 13 16:27:02.589320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 289/630] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:02 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 34818 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:27:02.616158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:02.616786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:02.624500 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.624955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.625780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.626227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.751792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:02.760213 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9937fc12-e2db-4a5e-9a91-2cd3190e32ba tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1275 microversion: 2.1 time: 0.147741 May 13 16:27:02.760790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 342/631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:02 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:02.924777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:02.925391 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:02.933769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.934272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.935039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:02.935470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:02.997011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:03.083594 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:03.084207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.091614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.092065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.092846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.093312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.297982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:03.309835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-38583f1d-f8a7-4673-b587-8621f72fadcd tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1512 microversion: 2.1 time: 0.229937 May 13 16:27:03.310410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 343/632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:03 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:03.315070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:03.315689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.322869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.323332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.324199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.324652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.468957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-eadf7259-da19-4811-a404-93e2593fe1af tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 204 len: 0 microversion: 2.1 time: 0.547466 May 13 16:27:03.469831 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 290/633] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:02 2021] DELETE /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:03.476648 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:03.477477 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.486282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.486840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.487695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.488214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.533714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:03.543606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c9f44024-376e-49c9-9a8f-0dd18730868e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.231325 May 13 16:27:03.545529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 344/634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:03 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:03.551007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-3b4418f2-50cb-4ec0-a69b-e0da11e67e7b req-6ddaff8d-f4e5-4ae7-94e2-a53c0a423378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590e1a04-937f-4d07-9cbf-41abae54cb76", "name": "network-vif-plugged", "status": "completed", "tag": "f7c06216-8f54-488d-a87b-b267aa1960d0"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:03.553318 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:03.553318 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:03.562533 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-3b4418f2-50cb-4ec0-a69b-e0da11e67e7b req-6ddaff8d-f4e5-4ae7-94e2-a53c0a423378 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.563078 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-3b4418f2-50cb-4ec0-a69b-e0da11e67e7b req-6ddaff8d-f4e5-4ae7-94e2-a53c0a423378 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.579511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-3b4418f2-50cb-4ec0-a69b-e0da11e67e7b req-6ddaff8d-f4e5-4ae7-94e2-a53c0a423378 service nova] Creating event network-vif-plugged:f7c06216-8f54-488d-a87b-b267aa1960d0 for instance 590e1a04-937f-4d07-9cbf-41abae54cb76 on hv-cinder-68948 May 13 16:27:03.584553 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-3b4418f2-50cb-4ec0-a69b-e0da11e67e7b req-6ddaff8d-f4e5-4ae7-94e2-a53c0a423378 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037600 May 13 16:27:03.585293 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 345/635] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:03.591375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:03.592081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.601758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.602609 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.603821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.604269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.820306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:03.828945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bc6bb331-3b07-4d1b-99f5-8931858175ce tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1501 microversion: 2.1 time: 0.242228 May 13 16:27:03.829718 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 346/636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:03 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:03.834407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:03.835522 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.843460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.844037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.844928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.845501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.864560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:03.874199 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-96dbfc40-2e39-47d0-a4d4-2ec8c4ae5f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.401764 May 13 16:27:03.874454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 291/637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:03 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:03.879043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:03.879701 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:03.888018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.888477 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:03.889307 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:03.889904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.007748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:04.015924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a12535a5-fa9a-45aa-838d-d947cd7b847c tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1273 microversion: 2.1 time: 0.140430 May 13 16:27:04.016484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 292/638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:03 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:04.037277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a61668ee-1837-4ec5-912b-31482adeac26 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 35355 microversion: 2.20 time: 0.206081 May 13 16:27:04.043848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 347/639] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:03 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 35355 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:04.326393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:04.326995 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:04.334187 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.334645 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.335426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.335867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.532984 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:04.541110 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e3a04fc3-0335-4173-b1ae-b5ed364701f5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1512 microversion: 2.1 time: 0.218563 May 13 16:27:04.541723 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 293/640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:04 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:04.561414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:04.562229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:04.570395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.570846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.571630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.572081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.764939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:04.773436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8f13f0ba-7455-43fe-8cba-4cd71564c59f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.216017 May 13 16:27:04.774052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 348/641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:04 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:04.846392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:04.847051 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:04.854682 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.855170 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.855957 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.856395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.891121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:04.891738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:04.899251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.899725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:04.900511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:04.900946 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.111574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:05.121067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6906d910-c062-437d-bdab-99b228dee155 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.233749 May 13 16:27:05.121861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 349/642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:04 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:05.134706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:05.135332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:05.142919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.143384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.144177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.144655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.308637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:05.317562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-12218904-d43c-4575-a4b2-8290c48faae0 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1501 microversion: 2.1 time: 0.474646 May 13 16:27:05.318728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 294/643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:04 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:05.323588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:05.325166 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:05.332528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.333062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.333952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.334471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.424126 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:05.432362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b441d759-6f54-459e-a028-b2dc7bf78298 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.301645 May 13 16:27:05.432937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 350/644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:05 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:05.556488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-334e719c-8309-419c-b581-0b8ca72189b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 35916 microversion: 2.20 time: 0.236258 May 13 16:27:05.557928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 295/645] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:05 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 35916 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:05.565826 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:05.567924 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:05.583407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.584220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.585684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.586797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.796696 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:05.797600 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:05.806220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.806673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.807468 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:05.807906 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:05.831915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:05.843624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f52a41f6-4538-4787-b1a8-7309b9a3226e tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1512 microversion: 2.1 time: 0.288035 May 13 16:27:05.844458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 351/646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:05 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:06.046036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:06.054136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3b46a213-fdd1-4729-a236-dfc6e831ed14 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1317 microversion: 2.1 time: 0.267057 May 13 16:27:06.054705 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 296/647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:05 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:06.137878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:06.139692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:06.140199 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-2c7b91a4-d0d5-4743-971b-a52ec48b183f req-930a7b0d-e1a3-414a-98ce-26f2a6ab9158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006dbc39-9e4b-4709-8586-b71f1089ea05", "tag": "9de37502-367a-404c-89dd-44496b3fe7d0"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:06.142259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:06.142259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:27:06.147336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.147787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.148886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.149244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.155440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-2c7b91a4-d0d5-4743-971b-a52ec48b183f req-930a7b0d-e1a3-414a-98ce-26f2a6ab9158 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.156169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-2c7b91a4-d0d5-4743-971b-a52ec48b183f req-930a7b0d-e1a3-414a-98ce-26f2a6ab9158 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.184993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-2c7b91a4-d0d5-4743-971b-a52ec48b183f req-930a7b0d-e1a3-414a-98ce-26f2a6ab9158 service nova] Creating event network-changed:9de37502-367a-404c-89dd-44496b3fe7d0 for instance 006dbc39-9e4b-4709-8586-b71f1089ea05 on hv-cinder-68948 May 13 16:27:06.189864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-2c7b91a4-d0d5-4743-971b-a52ec48b183f req-930a7b0d-e1a3-414a-98ce-26f2a6ab9158 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053976 May 13 16:27:06.190890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 297/648] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:06.336295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:06.337004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:06.344530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.345118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.345811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.346262 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.407619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:06.417364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f02d7abf-fb79-486a-96a5-650ae4c625c6 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.283058 May 13 16:27:06.427516 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 352/649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:06 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:06.450048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:06.450668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:06.458365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.458824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.459626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.460058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.645303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:06.654679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d55ac75f-ccc5-40f5-8ad3-9eb23d7e68d7 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1501 microversion: 2.1 time: 0.322596 May 13 16:27:06.655433 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 298/650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:06 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:06.660610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:06.661927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:06.687460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.689848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.692378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.693061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.809746 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:06.818729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2311e935-1c5e-4e83-b43b-87c16c515701 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.373113 May 13 16:27:06.819342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 353/651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:06 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:06.862021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:06.862700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:06.870216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.870712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.877932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:06.877932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:06.946959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-204d61db-9202-4935-9383-32ebfd5a6911 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 36466 microversion: 2.20 time: 0.289812 May 13 16:27:06.947686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 299/652] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:06 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 36466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:07.072327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:07.073121 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:07.084910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.084910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.084910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.084910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.200923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:07.210572 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-05c75a8f-db03-413e-a3a8-16ad2e889eed tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1512 microversion: 2.1 time: 0.352339 May 13 16:27:07.216199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 354/653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:06 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:07.435829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:07.436092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:07.444502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.444967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.445809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.446262 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.512696 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:07.522009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3f17a40f-2460-4eb5-9450-925b2b01ddfb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1506 microversion: 2.1 time: 0.454056 May 13 16:27:07.522726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 300/654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:07 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:07.677980 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:07.680374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:07.695922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.696677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.697778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.698489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.772481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:07.781518 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ccb29ef0-a994-4807-9332-75aff9e6a511 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.350354 May 13 16:27:07.782094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 355/655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:07 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:07.836356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:07.836943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:07.844732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.845533 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.846344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.846791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.913133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:07.922872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-59804fbb-5954-47dc-bd78-1f0f73678edd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1501 microversion: 2.1 time: 0.252608 May 13 16:27:07.923455 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 301/656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:07 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1501 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:07.959836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:07.960959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:07.968323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.968834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:07.969591 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:07.970025 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.049322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:08.057695 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6a914d39-1954-4759-beb7-c2b1c88ce653 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.225298 May 13 16:27:08.058305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 356/657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:07 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:08.221816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-4261a079-4fa2-4f66-a429-d84559c40eb6 req-3254bf96-71eb-4298-ab4a-ad13ecbb6254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53c86b7-07d6-450d-8987-4ecaabb80bd2", "name": "network-vif-deleted", "tag": "1533ac6c-95eb-4a37-b138-4afe4d1ecc03"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:08.221816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:08.221816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:08.224551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-4261a079-4fa2-4f66-a429-d84559c40eb6 req-3254bf96-71eb-4298-ab4a-ad13ecbb6254 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.225008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-4261a079-4fa2-4f66-a429-d84559c40eb6 req-3254bf96-71eb-4298-ab4a-ad13ecbb6254 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.233545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-56d380ab-b881-473b-a98f-a4a33b904f80 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 37188 microversion: 2.20 time: 0.277199 May 13 16:27:08.234712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 302/658] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:07 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 37188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:08.241690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:08.242783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:08.245976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-4261a079-4fa2-4f66-a429-d84559c40eb6 req-3254bf96-71eb-4298-ab4a-ad13ecbb6254 service nova] Creating event network-vif-deleted:1533ac6c-95eb-4a37-b138-4afe4d1ecc03 for instance c53c86b7-07d6-450d-8987-4ecaabb80bd2 on hv-cinder-68948 May 13 16:27:08.250683 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-4261a079-4fa2-4f66-a429-d84559c40eb6 req-3254bf96-71eb-4298-ab4a-ad13ecbb6254 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039501 May 13 16:27:08.251283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 357/659] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:08.253313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.254129 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.254979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.255443 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.344176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.344549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.345026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lazy-loading 'fault' on Instance uuid c53c86b7-07d6-450d-8987-4ecaabb80bd2 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:08.541319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:08.546615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c52c13f8-174a-48c5-a6da-09dfaf9c1121 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 200 len: 1308 microversion: 2.1 time: 0.309346 May 13 16:27:08.547715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 303/660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:08 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:08.799138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:08.800029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:08.807813 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.808432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.809331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.809908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.939776 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:08.940430 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:08.947952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.948406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:08.949215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:08.949656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.080952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:09.090319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3360bd34-6ab2-4578-8fe0-4b4686598338 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1459 microversion: 2.1 time: 0.154279 May 13 16:27:09.090900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 304/661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:08 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:09.104693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:09.106001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:09.113437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.113893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.119820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.119820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.152953 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:09.162678 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4c040aa7-b928-46d8-ae8e-0d0e7e0e6945 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.367895 May 13 16:27:09.163624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 358/662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:08 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:09.169421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-593066ff-3920-498a-a84e-95a4572aec54 req-87e666ad-840d-4ef2-ad9c-a01a3bfda3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad82bd9-50e6-4d3b-9c13-d2a9afce29be", "name": "network-vif-deleted", "tag": "3820e178-e1c9-4746-af52-39c0452d5c19"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:09.171263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:09.171263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:09.179452 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-593066ff-3920-498a-a84e-95a4572aec54 req-87e666ad-840d-4ef2-ad9c-a01a3bfda3f1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.180092 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-593066ff-3920-498a-a84e-95a4572aec54 req-87e666ad-840d-4ef2-ad9c-a01a3bfda3f1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.196136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-593066ff-3920-498a-a84e-95a4572aec54 req-87e666ad-840d-4ef2-ad9c-a01a3bfda3f1 service nova] Creating event network-vif-deleted:3820e178-e1c9-4746-af52-39c0452d5c19 for instance fad82bd9-50e6-4d3b-9c13-d2a9afce29be on hv-cinder-68948 May 13 16:27:09.202359 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-593066ff-3920-498a-a84e-95a4572aec54 req-87e666ad-840d-4ef2-ad9c-a01a3bfda3f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 May 13 16:27:09.203428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 359/663] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:09.258384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:09.259424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:09.267435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.267891 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.268687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.269319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.481743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7f986bb-648e-41f3-9883-b2a3a22a8b7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 37691 microversion: 2.20 time: 0.236784 May 13 16:27:09.483788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 360/664] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:09 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 37691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:27:09.488098 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "049ad591-7702-4d52-8042-15c21f33bb91"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:09.489253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:09.497694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.498149 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.498937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.499503 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.602395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:09.611590 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-25613694-1957-4f41-a684-6bc19dd30fbe tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.510582 May 13 16:27:09.612166 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 305/665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:09 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:09.626319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:09.626319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: c53c86b7-07d6-450d-8987-4ecaabb80bd2] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:09.626319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.626319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.626949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:09.626949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:09.686518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] HTTP exception thrown: Instance c53c86b7-07d6-450d-8987-4ecaabb80bd2 could not be found. May 13 16:27:09.687136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Returning 404 to user: Instance c53c86b7-07d6-450d-8987-4ecaabb80bd2 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:09.688010 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-651950a9-e585-47dc-9596-47efc9ffadef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2" status: 404 len: 111 microversion: 2.1 time: 0.074837 May 13 16:27:09.688577 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 306/666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:09 2021] GET /compute/v2.1/servers/c53c86b7-07d6-450d-8987-4ecaabb80bd2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:27:10.111305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:10.112344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:10.124579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.125286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.126131 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.126726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.199755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.200377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.200884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lazy-loading 'fault' on Instance uuid fad82bd9-50e6-4d3b-9c13-d2a9afce29be {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:10.299750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d073338bb45e7a0fd76b4a662cf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc2aa4ccfb477ebc03dad77a3f3273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:10.309844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d7cc365b-75bc-4599-9226-96edb001d960 tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 200 len: 1303 microversion: 2.1 time: 0.203645 May 13 16:27:10.310425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 307/667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:10 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:10.315644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:10.316302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:10.327586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.328066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.328894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.329399 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.533828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:10.544704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6a972722-1e48-49c0-ae55-05a13dc74030 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.232575 May 13 16:27:10.545326 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 308/668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:10 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:10.550595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:10.551529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:10.560283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.560524 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.561368 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.561814 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.625171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-317d24a9-5855-4312-b256-746888998d50 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "POST /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140990 May 13 16:27:10.630268 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 361/669] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:27:09 2021] POST /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76/os-volume_attachments => generated 194 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:10.636283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:10.637000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:10.650052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.650052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.650052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:10.650052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:10.771175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0a32f2e0-90da-4d74-aa1a-078c956fb16c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 38499 microversion: 2.20 time: 0.224112 May 13 16:27:10.771743 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 309/670] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:10 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 38499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:10.863003 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:10.873654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-55ddacab-69a2-41c4-918d-06225e3691b9 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.241652 May 13 16:27:10.874242 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 362/671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:10 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:11.328155 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:11.328891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] [instance: fad82bd9-50e6-4d3b-9c13-d2a9afce29be] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:11.337779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.338221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.339074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.340078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.393218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] HTTP exception thrown: Instance fad82bd9-50e6-4d3b-9c13-d2a9afce29be could not be found. May 13 16:27:11.393852 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] Returning 404 to user: Instance fad82bd9-50e6-4d3b-9c13-d2a9afce29be could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:11.394858 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-61a8192a-38ea-4bf8-8bb3-a9fe0dcd06cd tempest-VolumesActionsTest-449632074 tempest-VolumesActionsTest-449632074-project] 10.222.0.42 "GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be" status: 404 len: 111 microversion: 2.1 time: 0.071220 May 13 16:27:11.395484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 310/672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:11 2021] GET /compute/v2.1/servers/fad82bd9-50e6-4d3b-9c13-d2a9afce29be => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:27:11.575671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:11.575671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:11.575671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.575671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.576829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.576829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.778574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:11.786288 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:11.787866 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:11.788282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-69a9e5fb-4124-41b9-a0c6-50c209750e34 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.229035 May 13 16:27:11.789270 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 363/673] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:11 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:11.796935 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.797920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.798956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.799595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.891226 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:11.891842 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:11.899447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.899909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:11.900689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:11.901164 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:12.097563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:12.107003 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e8bc5eb3-4446-4b7d-99b9-675f0a6e74f5 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.219414 May 13 16:27:12.107586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 364/674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:11 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:12.805657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:12.814776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:12.814776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:12.814776 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:12.815275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:12.815716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:13.023968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:13.033869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5951d6ff-fa1c-46ee-b273-f239b08a6df5 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.231977 May 13 16:27:13.034720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 365/675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:12 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:13.123953 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:13.124580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:13.132481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:13.132940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:13.133775 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:13.134232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:13.340717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:13.349233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ab16ee43-cb6e-4bf3-8f9f-e22f82fa3181 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.228951 May 13 16:27:13.349810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 366/676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:13 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:14.051024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:14.051699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:14.059613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:14.060069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:14.060886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:14.061353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:14.258738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:14.267607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-23fac5e9-356e-4447-826f-efebf6ffe6bf tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.220293 May 13 16:27:14.268178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 367/677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:14 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:14.366675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:14.367287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:14.376948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:14.377444 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:14.378375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:14.378821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:14.484441 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dfb735ef-2f6e-4bb7-aeb9-4807eada3648 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 38951 microversion: 2.20 time: 2.705375 May 13 16:27:14.486175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 311/678] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:11 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 38951 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:27:14.582076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:14.590656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0436851a-26aa-450b-adac-777d7a4bcb49 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.227669 May 13 16:27:14.591219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 368/679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:14 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:15.285185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:15.285924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:15.294024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.294481 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.295272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.295719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.494962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:15.496502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:15.497523 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:15.504638 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-89ce0805-be18-4da1-8d21-4883b24b4178 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.223604 May 13 16:27:15.514578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.514740 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 312/680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:15 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:15.514857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.514857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.514857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.607603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:15.608478 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:15.615881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.616339 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.617169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:15.617601 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:15.817324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:15.822661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3517587e-6319-4b1f-af47-17194d916720 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.218836 May 13 16:27:15.823237 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 313/681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:15 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:16.521922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:16.522513 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:16.530928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:16.531377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:16.532233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:16.532679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:16.733669 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:16.742465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ae5bda21-284f-421e-a307-2038bf0bde22 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.224122 May 13 16:27:16.742961 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 314/682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:16 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:16.838671 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:16.839944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:16.847150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:16.847603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:16.848381 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:16.848820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:17.047332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:17.055799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c4994e81-794c-4f40-933d-883ed91829d3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.220788 May 13 16:27:17.056366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 315/683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:16 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:17.759132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:17.759744 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:17.767013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:17.767474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:17.768253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:17.768693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:17.960386 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:17.969793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-492cf088-d5d4-4ecb-9041-cb6d21ead566 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.214379 May 13 16:27:17.970454 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 316/684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:17 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:18.074068 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:18.074715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:18.082119 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.082571 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:18.083353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.083791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:18.153509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0e709966-bd8c-4e2f-a824-f82e517cc6f9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 200 len: 39094 microversion: 2.20 time: 2.661208 May 13 16:27:18.159904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 369/685] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:15 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 39094 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:27:18.165654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:18.169519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:18.174227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.174691 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:18.175488 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.175934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:18.234959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4b171682-a447-4e07-b94e-c727933023a2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/ips" status: 200 len: 151 microversion: 2.20 time: 0.073435 May 13 16:27:18.241198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 370/686] 10.222.0.42 () {60 vars in 1289 bytes} [Thu May 13 16:27:18 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/ips => generated 151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:27:18.305517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:18.315751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7d9d0691-7a65-469f-9831-400c57bffb7e tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.245510 May 13 16:27:18.316337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 317/687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:18 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:18.987101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:18.987895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:18.996041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.996496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:18.997312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:18.997753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:19.214840 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:19.227280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e51f9f63-f834-4125-86dd-266c31bff2a7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.243758 May 13 16:27:19.233494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 371/688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:18 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:19.333304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:19.333854 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:19.342385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:19.342853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:19.343651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:19.344094 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:19.551937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:19.560458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cd869b69-0d0f-4be3-b677-9ee859af0b01 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.231044 May 13 16:27:19.561043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 318/689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:19 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:20.248104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:20.248713 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:20.256246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:20.256629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:20.257456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:20.257926 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:20.364264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-d4441191-60e6-4b8f-a2d1-71cc3d1562b3 req-6cc31f51-4d4c-4199-a2de-d2a5b1d82eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006dbc39-9e4b-4709-8586-b71f1089ea05", "name": "network-vif-plugged", "status": "completed", "tag": "9de37502-367a-404c-89dd-44496b3fe7d0"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:20.366538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:20.366538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:27:20.383131 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d4441191-60e6-4b8f-a2d1-71cc3d1562b3 req-6cc31f51-4d4c-4199-a2de-d2a5b1d82eea service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:20.393552 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d4441191-60e6-4b8f-a2d1-71cc3d1562b3 req-6cc31f51-4d4c-4199-a2de-d2a5b1d82eea service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:20.411537 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-d4441191-60e6-4b8f-a2d1-71cc3d1562b3 req-6cc31f51-4d4c-4199-a2de-d2a5b1d82eea service nova] Creating event network-vif-plugged:9de37502-367a-404c-89dd-44496b3fe7d0 for instance 006dbc39-9e4b-4709-8586-b71f1089ea05 on hv-cinder-68948 May 13 16:27:20.416422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-d4441191-60e6-4b8f-a2d1-71cc3d1562b3 req-6cc31f51-4d4c-4199-a2de-d2a5b1d82eea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057996 May 13 16:27:20.417393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 319/690] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:20.513848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:20.524151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-98abad40-1769-465b-afd7-0b32752d38c0 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.279911 May 13 16:27:20.524824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 372/691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:20 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:20.578834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:20.579790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:20.587699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:20.588280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:20.591137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:20.591786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:20.812358 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:20.822994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2258b5cc-0ccf-4ff5-8200-e4f5fe50b4ca tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.248631 May 13 16:27:20.824185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 320/692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:20 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:21.543641 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:21.544160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:21.552095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:21.552558 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:21.553379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:21.553825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:21.755364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:21.764247 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-86ded0ff-f5f0-4e00-8795-e2c26e4699cd tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.224983 May 13 16:27:21.764825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 373/693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:21 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:21.839933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:21.840652 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:21.848058 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:21.848504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:21.849311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:21.849750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:22.048575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:22.057041 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ed52d75b-f6c5-40dc-b1ca-1d32c1a5c407 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.221215 May 13 16:27:22.057647 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 321/694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:21 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:22.781121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:22.781732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:22.789174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:22.789586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:22.790367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:22.790804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:22.984254 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:22.992942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-27e1e705-07fc-41a5-aa59-686901577fe7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.215556 May 13 16:27:22.993536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 374/695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:22 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:23.073660 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:23.074296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:23.081676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:23.082142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:23.082892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:23.083345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:23.280512 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:23.288626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c4332703-c721-4d0d-8ed8-f3a1647cae75 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.218707 May 13 16:27:23.289219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 322/696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:23 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:24.009846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:24.010652 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:24.018833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.019339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.020111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.020547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.231863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:24.246754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ae15e711-7eb3-4447-9f15-00ffbd7d419f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.236167 May 13 16:27:24.246754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 375/697] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:24 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:24.305871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:24.306666 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:24.316337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.316863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.317709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.318148 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.603876 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:24.615484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4cb6afbd-4e54-46c9-95bf-3c0958bd59c4 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1315 microversion: 2.1 time: 0.313411 May 13 16:27:24.616568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 323/698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:24 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:24.723423 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:24.724074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:24.738944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.738944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.738944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:24.738944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:24.802375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lazy-loading 'flavor' on Instance uuid 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:25.105644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1430240724", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "networks": [{"uuid": "6b26855a-a663-49c7-acbe-02b43c2541a7"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:25.177297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] validate_networks() for [('6b26855a-a663-49c7-acbe-02b43c2541a7', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:27:25.595478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df8f6aa4-6558-4201-8e2d-f4a6e514e93e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 202 len: 0 microversion: 2.20 time: 0.875357 May 13 16:27:25.601279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 376/699] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:27:24 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:25.609368 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:25.610162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:25.626811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:25.627298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:25.628065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:25.628521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:25.885917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:27:25.888205 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:27:25.889566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:27:25.897659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:27:25.899434 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:27:25.973705 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:25.974958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:25.976180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:25.976740 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.041688 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Getting quotas for project 962a3c5540a24061b68fd96894c59c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:27:26.052799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Getting quotas for user b5adf0abb48b42aaba79305dd79c21ce and project 962a3c5540a24061b68fd96894c59c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:27:26.091323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:27:26.095904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:27:26.105911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.115210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ff92d943-a5ab-4d1d-aed6-20af3ba0f8af tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.512527 May 13 16:27:26.121873 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 377/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:25 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:26.126912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:26.131521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:26.147973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.148450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.149275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.149722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.269366 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a90de8bd-43a1-4461-a03e-6a1bb72f1076 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167530 May 13 16:27:26.272969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 324/701] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:27:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:27:26.290323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:26.309865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:26.341610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.343407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.345966 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.348106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.407336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.420672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.422578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.423907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2da5af45-1d94-4d27-acd9-dddb76565a52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.300738 May 13 16:27:26.424931 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 378/702] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:26 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:26.430933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df6487c6-5eb5-4317-a641-dbeb6c509db0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:26.431674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-df6487c6-5eb5-4317-a641-dbeb6c509db0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:26.567571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-df6487c6-5eb5-4317-a641-dbeb6c509db0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.576943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df6487c6-5eb5-4317-a641-dbeb6c509db0 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1219 microversion: 2.1 time: 0.150807 May 13 16:27:26.580597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 379/703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:26 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:26.723826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:26.734425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-50dc8a1f-ae29-4fb4-8b2a-867ab77cd5b8 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1464 microversion: 2.1 time: 0.457854 May 13 16:27:26.735291 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 325/704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:26 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1464 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:26.818893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:26.819465 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:26.829418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.829900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.830837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:26.831256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:26.926282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:27.142199 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:27.142833 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:27.152846 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.153373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.154276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.154718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.388907 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.399125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-657609d1-5789-482d-bf89-27f565842ed7 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.261904 May 13 16:27:27.410034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 326/705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:27 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:27.445317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:27.445930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:27.454500 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.456562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.456562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.456562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.487884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-85aeb10c-3678-4288-902a-b1c9d6822799 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "DELETE /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 204 len: 0 microversion: 2.1 time: 0.672637 May 13 16:27:27.495926 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 380/706] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:26 2021] DELETE /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:27.499297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:27.500251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:27.513584 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.514113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.514952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.515428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.711190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.722316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.723959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.725218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cbdaff6f-66c5-4d41-b166-37e21fb5b242 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.283940 May 13 16:27:27.725822 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 327/707] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:27 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:27:27.731848 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:27.732817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:27.742562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.743257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.744216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:27.744826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:27.856238 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.866326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f19d8296-9873-4267-bf50-94eb9990b509 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1470 microversion: 2.1 time: 0.371796 May 13 16:27:27.909311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 381/708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:27 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:27.949327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:27.960412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e1259ac9-990e-48bb-b6f3-2368e858377d tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1223 microversion: 2.1 time: 0.231527 May 13 16:27:27.966325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 328/709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:27 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1223 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:28.418346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:28.419041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:28.426805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.427270 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:28.428078 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.428535 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:28.744461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:28.746750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:28.760966 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.764357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:28.765777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.766843 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:28.772915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:28.783653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-53bf0d90-3234-4da6-a1b4-1b67dfc5c1d9 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1566 microversion: 2.1 time: 0.368334 May 13 16:27:28.784282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 382/710] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:28 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1566 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:28.923498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:28.924207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:28.937291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.937291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:28.937291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:28.940088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:29.018673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:29.028861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:29.030451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:29.031646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-43e820a3-b97a-4529-8d86-9f67c0990e46 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.291345 May 13 16:27:29.037521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 329/711] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:28 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:27:29.046486 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:29.047206 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:29.056322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:29.057141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:29.058081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:29.058637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:29.224665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:29.240622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-95affeda-777f-4586-b740-97c89c76a2ef tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1271 microversion: 2.1 time: 0.200552 May 13 16:27:29.253274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 330/712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:29 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:29.307108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:29.317102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-793f442f-a173-4fcb-bd77-f3dbb39e1505 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1470 microversion: 2.1 time: 0.397926 May 13 16:27:29.317721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 383/713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:28 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:29.803501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:29.804323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:29.813289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:29.813764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:29.814551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:29.815000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.050073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:30.050607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.050903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.061867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6df73b13-02b4-484f-a5e8-3372ae0f3461 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1546 microversion: 2.1 time: 0.262110 May 13 16:27:30.065499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 331/714] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:29 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:30.075538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.076171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.077070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.081046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:30.081695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.081825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.092115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.094231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.094231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.094548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.391306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] HTTP exception thrown: Cannot 'detach_volume' instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 while it is in vm_state rescued May 13 16:27:30.394001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Returning 409 to user: Cannot 'detach_volume' instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 while it is in vm_state rescued {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:30.395031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7187e487-5a1f-4ed0-bc61-4af7df467d12 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments/9f2e5b19-1a8b-4601-bb64-62c4f1c948bb" status: 409 len: 152 microversion: 2.1 time: 0.318655 May 13 16:27:30.395612 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 332/715] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:27:30 2021] DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments/9f2e5b19-1a8b-4601-bb64-62c4f1c948bb => generated 152 bytes in 320 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 13 16:27:30.406474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:30.411092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.430889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.432585 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.434985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.438009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.469520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.484961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.492112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.498327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7fb52682-4748-4698-8121-b81aa677d300 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.448213 May 13 16:27:30.500084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 384/716] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:30 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:30.508381 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:30.509839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.518572 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.519469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.520534 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.521190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.629095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.639195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-10d5586e-74f1-4a24-9ce9-a4cd14f0be31 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1277 microversion: 2.1 time: 0.242525 May 13 16:27:30.639797 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 333/717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:30 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:30.650345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:30.650345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.654510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.656063 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.656063 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.656353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.893950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:30.904474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3688c2e8-91d7-4bfd-961c-e8c9c357e73d tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1470 microversion: 2.1 time: 0.402949 May 13 16:27:30.905546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 385/718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:30 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:30.963889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-094a4e12-37b7-4937-aca2-0119581a9fd8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action" status: 202 len: 0 microversion: 2.1 time: 0.322809 May 13 16:27:30.965819 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 334/719] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:27:30 2021] POST /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:30.975175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:30.976422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:30.985687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.986362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:30.987328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:30.987927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:31.375316 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:31.385223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-86489d2e-0cc4-4314-b478-fbb4cc838f6b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1554 microversion: 2.1 time: 0.414609 May 13 16:27:31.396811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 386/720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:30 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1554 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:31.520330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:31.521554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:31.537950 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:31.538682 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:31.539818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:31.540413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:31.663355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:31.663974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:31.684352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:31.685627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:31.686631 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:31.687249 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:32.512030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:32.521671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-242068ff-8645-4bca-8988-9fc941bcd9c5 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.865776 May 13 16:27:32.523366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 387/721] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:31 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:32.536006 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:32.536901 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:32.547858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:32.549032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:32.550075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:32.550763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:32.608071 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:32.618763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:32.620876 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:32.622132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5cc9b492-6b11-4a7f-b65f-02031fdcfdf1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 1.106404 May 13 16:27:32.623035 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 335/722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:31 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:32.629338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:32.630020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:32.638551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:32.643997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:32.643997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:32.643997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.172248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:33.180702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-45081c97-9f5c-4d7f-8832-e79ffc2637dd tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1470 microversion: 2.1 time: 0.657279 May 13 16:27:33.184118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 388/723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:32 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1470 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:33.191747 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:33.192257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:33.208947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.214217 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.215905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.221720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.421613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'services' on Instance uuid 590e1a04-937f-4d07-9cbf-41abae54cb76 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:33.439796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:33.453658 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cfda115b-b7ac-4ace-a70f-95c149bc8501 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1554 microversion: 2.1 time: 0.827860 May 13 16:27:33.460803 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 336/724] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:32 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1554 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:33.540129 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:33.540891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:33.556554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.557016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.562049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.562630 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.798924 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f7a5ed62-4624-4507-8c45-7c5b578ba8b5 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76/os-volume_attachments/049ad591-7702-4d52-8042-15c21f33bb91" status: 202 len: 0 microversion: 2.1 time: 0.613576 May 13 16:27:33.800333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 389/725] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:27:33 2021] DELETE /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76/os-volume_attachments/049ad591-7702-4d52-8042-15c21f33bb91 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:33.827512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-ea1db639-969a-40a4-aa4b-d80374e2dbc8 req-1c498d4e-c06f-414c-82c3-a6ee414d6360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62", "tag": "154e87c3-b535-4f0a-acb8-3859c36da7a1"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:33.850072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:33.850072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:33.870481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ea1db639-969a-40a4-aa4b-d80374e2dbc8 req-1c498d4e-c06f-414c-82c3-a6ee414d6360 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.870946 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ea1db639-969a-40a4-aa4b-d80374e2dbc8 req-1c498d4e-c06f-414c-82c3-a6ee414d6360 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.896280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-ea1db639-969a-40a4-aa4b-d80374e2dbc8 req-1c498d4e-c06f-414c-82c3-a6ee414d6360 service nova] Creating event network-changed:154e87c3-b535-4f0a-acb8-3859c36da7a1 for instance 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 on hv-cinder-68948 May 13 16:27:33.901741 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-ea1db639-969a-40a4-aa4b-d80374e2dbc8 req-1c498d4e-c06f-414c-82c3-a6ee414d6360 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099715 May 13 16:27:33.902878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 390/726] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:33.909456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:33.910380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:33.935281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.935967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:33.937330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:33.938184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.226937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.239663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-20ff809f-40ea-4f31-bd3a-3f29ea9e447b tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.704213 May 13 16:27:34.250625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 337/727] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:33 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:34.256096 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-d7aba703-a416-4b08-a247-cd025345043c req-41ccd7c2-113c-4c9a-b1a7-7ecf3bcfb199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006dbc39-9e4b-4709-8586-b71f1089ea05", "name": "network-vif-deleted", "tag": "9de37502-367a-404c-89dd-44496b3fe7d0"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:34.263828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:34.263828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:27:34.267230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d7aba703-a416-4b08-a247-cd025345043c req-41ccd7c2-113c-4c9a-b1a7-7ecf3bcfb199 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:34.267687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d7aba703-a416-4b08-a247-cd025345043c req-41ccd7c2-113c-4c9a-b1a7-7ecf3bcfb199 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.292359 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-d7aba703-a416-4b08-a247-cd025345043c req-41ccd7c2-113c-4c9a-b1a7-7ecf3bcfb199 service nova] Creating event network-vif-deleted:9de37502-367a-404c-89dd-44496b3fe7d0 for instance 006dbc39-9e4b-4709-8586-b71f1089ea05 on hv-cinder-68948 May 13 16:27:34.298849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-d7aba703-a416-4b08-a247-cd025345043c req-41ccd7c2-113c-4c9a-b1a7-7ecf3bcfb199 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046864 May 13 16:27:34.301777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 338/728] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:34.307610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:34.308532 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:34.316557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:34.317011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.318009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:34.318530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.494999 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.504228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.511965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.525780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2380efbf-3857-47e4-90ee-842ce0b46db1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.617673 May 13 16:27:34.528402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 391/729] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:33 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:34.535788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:34.538408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:34.554440 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:34.556302 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.557791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:34.559448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:34.592264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.601300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6b08b042-1e53-4d19-819d-ca31e800fe74 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1428 microversion: 2.1 time: 0.298232 May 13 16:27:34.602413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 339/730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:34 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1428 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:34.930460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:34.942491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0247c798-9fe9-4a78-8044-0227ba77436b tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1554 microversion: 2.1 time: 0.411808 May 13 16:27:34.943769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 392/731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:34 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:35.256903 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:35.257817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:35.273654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.276373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.278236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.278970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.516672 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:35.527153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-387912b9-cb53-48da-b0ea-3c03a0588665 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.274263 May 13 16:27:35.528179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 340/732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:35 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:35.547238 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:35.551859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:35.562943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.563564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.565760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.567394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.618986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:35.620622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:35.630012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.630915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.632203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.632910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.728545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.729668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.730154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lazy-loading 'fault' on Instance uuid 006dbc39-9e4b-4709-8586-b71f1089ea05 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:35.792483 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184ac1443d74864b8ab494d65439f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5f5dbc15743818dd43878ebad5a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:35.802643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9247977d-b8b2-41c0-9664-f83421fe4741 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 200 len: 1305 microversion: 2.1 time: 0.187585 May 13 16:27:35.813127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 341/733] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:35 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:35.961033 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:35.961664 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:35.970401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.970964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:35.971827 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:35.972534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:36.031476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:36.042161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:36.043703 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:36.044832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0920a1a4-49d1-4a46-91c9-2923fe978f3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.502017 May 13 16:27:36.056684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 393/734] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:35 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:36.367572 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:36.382935 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ddb087e9-c100-4297-a267-2a421839d480 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1554 microversion: 2.1 time: 0.425758 May 13 16:27:36.383709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 342/735] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:35 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1554 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:36.553812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:36.555602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:36.584541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:36.590290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:36.590290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:36.591955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:36.821434 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:36.822459 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] [instance: 006dbc39-9e4b-4709-8586-b71f1089ea05] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:36.831103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:36.831804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:36.832824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:36.833564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:36.887310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:36.891305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] HTTP exception thrown: Instance 006dbc39-9e4b-4709-8586-b71f1089ea05 could not be found. May 13 16:27:36.891949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] Returning 404 to user: Instance 006dbc39-9e4b-4709-8586-b71f1089ea05 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:36.892794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3ae3563b-f90d-496a-a5c2-0662755197c3 tempest-VolumesNegativeTest-470220037 tempest-VolumesNegativeTest-470220037-project] 10.222.0.42 "GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05" status: 404 len: 111 microversion: 2.1 time: 0.076222 May 13 16:27:36.893549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 343/736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:36 2021] GET /compute/v2.1/servers/006dbc39-9e4b-4709-8586-b71f1089ea05 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:27:36.896508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c049ae02-8bdb-4d91-948b-852bc72d8c98 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.352859 May 13 16:27:36.896792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 394/737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:36 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:37.093746 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:37.094352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:37.103252 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.104049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:37.104784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.105264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:37.330546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:37.339634 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:37.341773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:37.343243 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1f1ca4a7-7dc6-4ba6-a3b6-e561057b6abc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.275307 May 13 16:27:37.345779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 344/738] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:37 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:37.401145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:37.401831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:37.410373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.410971 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:37.411964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.412394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:37.645546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:37.657571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-286597f7-495c-4633-87a6-b48b99267f40 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1554 microversion: 2.1 time: 0.261387 May 13 16:27:37.669888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 395/739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:37 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:37.915432 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:37.916087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:37.923774 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.927376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:37.927376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:37.927376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.165096 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:38.177419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-51afad4c-8f6e-4519-b492-4cef7ebf0ffa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.266634 May 13 16:27:38.179071 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 345/740] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:37 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:38.366969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:38.367704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:38.377168 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.377672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.378688 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.379200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.662270 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:38.673641 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:38.675222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:38.675587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:38.676069 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:38.678219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7d39622d-9c7e-4609-852e-666f8504a02d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.314878 May 13 16:27:38.678939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 396/741] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:38 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:27:38.691749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.693219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.695431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.695887 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.815020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:38.815712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:38.823441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.823984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.831546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:38.831546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:38.902756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:38.959522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:38.970378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b5c22fb0-e5f7-4d72-bba0-dbcd929302ef tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1560 microversion: 2.1 time: 0.299101 May 13 16:27:38.971236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 346/742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:38 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1560 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:39.118280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:39.118884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:39.126555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.127016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.127824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.128272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.332210 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'services' on Instance uuid a5c7c299-cc4b-4299-b6af-e0b4e21580e4 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:39.368432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-af28743f-1898-4588-8c64-dcfe274f477a tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 204 len: 0 microversion: 2.1 time: 0.555890 May 13 16:27:39.375457 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 397/743] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:38 2021] DELETE /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:39.410729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:39.412470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:39.440084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.443171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.452311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.453369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.719461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-017939c3-68e5-4a4f-b158-42f31c92083c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments/9f2e5b19-1a8b-4601-bb64-62c4f1c948bb" status: 202 len: 0 microversion: 2.1 time: 0.604607 May 13 16:27:39.720185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 347/744] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:27:39 2021] DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4/os-volume_attachments/9f2e5b19-1a8b-4601-bb64-62c4f1c948bb => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:39.732357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:39.736576 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:39.756986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.761765 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.763011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.763877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.783715 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:39.796633 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3cb0ff00-84be-4d92-a7c3-70e3995408d3 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.416981 May 13 16:27:39.798493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 398/745] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:39 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:39.813610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:39.818539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:39.832255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.832972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:39.833846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:39.834512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:40.169159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:40.179505 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:40.180539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:40.181847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:40.183867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-51190677-1c14-4581-aac6-5bd3b9acbd7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.384017 May 13 16:27:40.185108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 399/746] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:39 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:40.194019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-da776345-baf8-4a57-95e1-0b251b20ab60 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1512 microversion: 2.1 time: 0.472181 May 13 16:27:40.209668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 348/747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:39 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:40.816888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:40.817502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:40.825814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:40.826288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:40.827097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:40.827550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:41.096869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:41.100882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a3a08b14-3a05-4f70-8d44-16127bea1624 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.288420 May 13 16:27:41.101565 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 400/748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:40 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:41.202761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:41.203457 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:41.211428 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:41.212405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:41.214161 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:41.214907 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:41.218390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:41.219735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:41.230303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:41.230867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:41.231768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:41.232301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:41.549480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:41.561010 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:41.561726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:41.563983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:41.566559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-139ad3bd-80ac-46a6-bece-3c9a2ef86370 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.366736 May 13 16:27:41.568781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 349/749] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:41 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:41.576472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-06e06fd9-0b86-43d4-a536-f4eef390677d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1512 microversion: 2.1 time: 0.364830 May 13 16:27:41.577064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 401/750] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:41 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:42.119735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:42.120355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:42.127742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.135889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.135889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.135889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.398058 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:42.409428 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-76f8aa11-7a57-417d-9e39-dd6d6d424953 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.293473 May 13 16:27:42.420237 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 350/751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:42 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:42.591013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:42.591576 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:42.596444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:42.598257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:42.608064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.608529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.609364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.610103 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.618527 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.621118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.622453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:42.624626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:42.904993 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:42.909822 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:42.921470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1365e5d3-40cb-4cde-842a-ca3f37c04471 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1512 microversion: 2.1 time: 0.331548 May 13 16:27:42.922241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:42.924446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:42.925924 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-31cdb95a-22e3-4a3c-b2b8-5092ba40c516 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.340087 May 13 16:27:42.931160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 351/752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:42 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:42.933754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 402/753] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:42 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:43.430851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:43.432396 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:43.441731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.442181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:43.443155 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.443785 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:43.692676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:43.701338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-473b66ea-2c00-4ea5-9fbf-925bfe4dd3f4 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.275300 May 13 16:27:43.708024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 352/754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:43 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:43.939343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:43.940583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:43.950610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:43.952220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:43.960707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.961214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:43.962040 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.962498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:43.967708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.971374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:43.971374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:43.971374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:44.276887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:44.287127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f5c67b3c-6d66-4144-a6f2-908cdff7d6cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1470 microversion: 2.1 time: 0.351540 May 13 16:27:44.287739 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 403/755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:43 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:44.293967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-cbef61a7-94e7-4b52-8274-529a865f5ea9 req-02bae08f-edd4-4672-85db-1a064dec43bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590e1a04-937f-4d07-9cbf-41abae54cb76", "name": "network-vif-deleted", "tag": "f7c06216-8f54-488d-a87b-b267aa1960d0"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:44.295760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:44.295760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:44.305991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-cbef61a7-94e7-4b52-8274-529a865f5ea9 req-02bae08f-edd4-4672-85db-1a064dec43bc service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:44.305991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-cbef61a7-94e7-4b52-8274-529a865f5ea9 req-02bae08f-edd4-4672-85db-1a064dec43bc service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:44.334863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-cbef61a7-94e7-4b52-8274-529a865f5ea9 req-02bae08f-edd4-4672-85db-1a064dec43bc service nova] Creating event network-vif-deleted:f7c06216-8f54-488d-a87b-b267aa1960d0 for instance 590e1a04-937f-4d07-9cbf-41abae54cb76 on hv-cinder-68948 May 13 16:27:44.335726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:44.341122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-cbef61a7-94e7-4b52-8274-529a865f5ea9 req-02bae08f-edd4-4672-85db-1a064dec43bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051519 May 13 16:27:44.342200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 404/756] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:44.347274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:44.348898 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:44.350078 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f6447194-554c-40b3-86fc-2c15fc3ec980 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.408631 May 13 16:27:44.350636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 353/757] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:43 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:44.732850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-0a6f9e1f-6e02-4aa9-ac15-0c2710d0826c req-65d29ad6-d1c7-4e61-a652-54104594be2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62", "name": "network-vif-plugged", "status": "completed", "tag": "154e87c3-b535-4f0a-acb8-3859c36da7a1"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:44.734489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:44.734489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:27:44.737797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:44.738614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:44.747258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:44.748649 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-0a6f9e1f-6e02-4aa9-ac15-0c2710d0826c req-65d29ad6-d1c7-4e61-a652-54104594be2f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:44.748782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:44.748888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-0a6f9e1f-6e02-4aa9-ac15-0c2710d0826c req-65d29ad6-d1c7-4e61-a652-54104594be2f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:44.748986 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:44.749335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:44.766461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-0a6f9e1f-6e02-4aa9-ac15-0c2710d0826c req-65d29ad6-d1c7-4e61-a652-54104594be2f service nova] Creating event network-vif-plugged:154e87c3-b535-4f0a-acb8-3859c36da7a1 for instance 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 on hv-cinder-68948 May 13 16:27:44.771174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-0a6f9e1f-6e02-4aa9-ac15-0c2710d0826c req-65d29ad6-d1c7-4e61-a652-54104594be2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043084 May 13 16:27:44.772323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 354/758] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:27:45.000780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:45.013409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ff8fadf0-0bf6-4d3e-a455-f3cb577fc282 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.292966 May 13 16:27:45.023667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 405/759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:44 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:45.223229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:45.224044 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:45.233237 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.233970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.234984 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.235657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.303562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:45.304183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:45.308221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:45.320577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.321038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.321866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.322315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.477884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.479165 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.479791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid 590e1a04-937f-4d07-9cbf-41abae54cb76 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:45.549964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:45.573582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-19df7cbe-5d86-4b3a-baab-72392d48c1cb tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 200 len: 1307 microversion: 2.1 time: 0.270696 May 13 16:27:45.577828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 406/760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:45 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:45.586045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:45.586679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:45.598333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.601305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.601305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.601305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.736835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-eb346d66-ffe8-46fb-973e-b99fb5866a1e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 204 len: 0 microversion: 2.1 time: 0.517492 May 13 16:27:45.738117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 355/761] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:45 2021] DELETE /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:45.746915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:45.747859 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:45.756098 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.756850 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.757839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:45.758385 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:45.903394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:45.913524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:45.915525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:45.918112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2b231d30-6a20-409d-aaed-b667b52c3ad6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.337353 May 13 16:27:45.929705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 407/762] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:45 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:46.031485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:46.032868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:46.042418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.043598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:46.044162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.044760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:46.060742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:46.073763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8ab7dbc5-12cd-4e3f-89fe-7a0bd119e23f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1506 microversion: 2.1 time: 0.330272 May 13 16:27:46.084220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 356/763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:45 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:46.341597 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:46.351371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7d49ebdb-91d0-4cc5-a398-61c396ab9bb2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.323743 May 13 16:27:46.355277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 408/764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:46 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:46.594109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:46.594801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 590e1a04-937f-4d07-9cbf-41abae54cb76] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:46.604522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.605004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:46.605970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.606759 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:46.662312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Instance 590e1a04-937f-4d07-9cbf-41abae54cb76 could not be found. May 13 16:27:46.664494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 404 to user: Instance 590e1a04-937f-4d07-9cbf-41abae54cb76 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:46.664494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ab1d0756-b976-4984-8af2-cb27baaec174 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76" status: 404 len: 111 microversion: 2.1 time: 0.075838 May 13 16:27:46.668311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 357/765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:46 2021] GET /compute/v2.1/servers/590e1a04-937f-4d07-9cbf-41abae54cb76 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:27:46.936056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:46.938217 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:46.946574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.948056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:46.949161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:46.949852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:47.091613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:47.092383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:47.101218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:47.101683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:47.102737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:47.103347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:47.154703 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:47.163826 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:47.165393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:47.166630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f986b2b6-f787-4d15-9788-f7e3c3e253a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.234469 May 13 16:27:47.167236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 409/766] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:46 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:47.333896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:47.342863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-91e41c81-f310-4f0e-8116-9afaa39ddf26 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1506 microversion: 2.1 time: 0.255030 May 13 16:27:47.343724 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 358/767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:47 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:47.370938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:47.371559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:47.380246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:47.380711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:47.381745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:47.382193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:47.697664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:47.697664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e57bbb60-ff78-4e52-9c9c-6ffabd866adb tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1319 microversion: 2.1 time: 0.317753 May 13 16:27:47.697664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 410/768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:47 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:48.027820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:48.029485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:48.037942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.039018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.040001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.040568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.116404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:48.186205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:48.187690 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:48.195762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.196514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.198115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.198725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.444347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:48.455519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:48.457354 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:48.458770 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3fe087a4-5683-4921-908f-00f12e0d0816 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.278548 May 13 16:27:48.470181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 411/769] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:48 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:48.473199 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8825be2d-520b-4d8e-8829-94ad559b4ab4 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 204 len: 0 microversion: 2.1 time: 0.450516 May 13 16:27:48.476475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 359/770] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:48 2021] DELETE /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:48.476604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:48.476604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:48.485191 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.485941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.486957 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.487563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.505141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:48.516849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:48.530302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.534301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.536208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.538525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.788362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:48.797197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e32b2cb1-7f56-4e72-a121-7db3f68c35c3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1506 microversion: 2.1 time: 0.325514 May 13 16:27:48.797885 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 412/771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:48 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:48.802180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:48.802803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:48.813695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:48.816205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.816744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.818142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:48.818637 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:48.822031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-32f3f1e0-75e3-427f-a202-0ada9e2c2b0f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1514 microversion: 2.1 time: 0.331073 May 13 16:27:48.823447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 360/772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:48 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:49.013480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:49.021929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4ca3e6b1-c446-47ad-9b25-48a070d4739f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1507 microversion: 2.1 time: 0.222997 May 13 16:27:49.022521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 413/773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:48 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:49.038560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4815c41-9075-4743-87fa-185f88b1340d", "device": "/dev/sdb"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:49.039787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:49.047933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.048488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.049399 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.049913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.477574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:49.478241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:49.486193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.489009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.489009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.489009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.690934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:49.701856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:49.703825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:49.705253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-eee39ecf-c336-4444-8184-4a36ca605ecb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.231724 May 13 16:27:49.705829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 414/774] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:49 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:49.819379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:49.820091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:49.828079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.828630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.829457 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:49.829781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:49.995886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9cb07daa-daab-4d79-9172-4de96fbdeaf9 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "POST /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960854 May 13 16:27:50.003557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 361/775] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:27:49 2021] POST /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:50.023001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:50.023724 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:50.040594 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:50.041183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:50.041999 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:50.042431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:50.128679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:50.140066 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-63b11977-ac3e-41f2-88a1-d13b9ad1f08d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1506 microversion: 2.1 time: 0.324317 May 13 16:27:50.140763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 415/776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:49 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:50.264039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:50.271327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-af8b2a64-b3d1-43cf-a245-e2694a436700 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1514 microversion: 2.1 time: 0.272269 May 13 16:27:50.271893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 362/777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:49 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:50.723631 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:50.724243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:50.732650 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:50.733129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:50.733915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:50.734353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:50.932955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:50.942140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:50.943671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:50.944823 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f76705d8-f75b-4098-b112-ddc7984b2276 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.224916 May 13 16:27:50.945436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 416/778] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:50 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:51.157005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:51.157662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:51.165734 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.166191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:51.166985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.167427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:51.290854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:51.292486 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:51.305047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.306352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:51.308038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.308634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:51.383913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:51.393778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cd2363dc-db24-4645-8ad6-7291df83690a tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1506 microversion: 2.1 time: 0.240510 May 13 16:27:51.394355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 363/779] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:51 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:51.726574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:51.738030 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60e9ad13-3cda-413d-ae68-e50753712128 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1514 microversion: 2.1 time: 0.453732 May 13 16:27:51.738754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 417/780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:51 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:51.964932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:51.965579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:51.973219 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.974021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:51.975045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:51.975687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.032575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-ae8b0fb2-dd8e-43d6-8fd0-880c5dfde940 req-f63a991d-aafc-4c04-8c04-5dd73ed60322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf1269-b8cb-46b2-ba2c-e02abc16df28", "name": "network-vif-deleted", "tag": "9516730e-2cbf-4b11-9412-8451718c0ac6"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:52.035295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:52.035295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:52.046836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ae8b0fb2-dd8e-43d6-8fd0-880c5dfde940 req-f63a991d-aafc-4c04-8c04-5dd73ed60322 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.052360 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ae8b0fb2-dd8e-43d6-8fd0-880c5dfde940 req-f63a991d-aafc-4c04-8c04-5dd73ed60322 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.066567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-ae8b0fb2-dd8e-43d6-8fd0-880c5dfde940 req-f63a991d-aafc-4c04-8c04-5dd73ed60322 service nova] Creating event network-vif-deleted:9516730e-2cbf-4b11-9412-8451718c0ac6 for instance 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 on hv-cinder-68948 May 13 16:27:52.071937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-ae8b0fb2-dd8e-43d6-8fd0-880c5dfde940 req-f63a991d-aafc-4c04-8c04-5dd73ed60322 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044632 May 13 16:27:52.073443 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 418/781] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:52.412462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:52.413238 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:52.421150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.421608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.422401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.422858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.442083 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:52.452844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:52.455527 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:52.456350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9330f8e1-8787-4d9c-8feb-805e4692f0df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.495903 May 13 16:27:52.457474 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 364/782] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:51 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:52.500756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.505420 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.505420 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'fault' on Instance uuid 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:52.695463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:52.704646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60661254-ac90-4a2a-8838-cd9781d8a589 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 200 len: 1311 microversion: 2.1 time: 0.296473 May 13 16:27:52.705282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 419/783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:52 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:52.755132 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:52.755845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:52.763492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.763949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.764761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:52.765247 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:52.927979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:52.940777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-97a7053b-4dc3-4021-8f29-0983f70a8168 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1472 microversion: 2.1 time: 0.189021 May 13 16:27:52.942266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 365/784] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:52 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:52.999640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-ab8f1b1c-ffa1-42f0-8cea-16df6d1ded2f req-8993f7fc-6f66-4160-80a5-58f3a38e78ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9953c737-dccb-4150-a5e9-6717bbb4d2b8", "name": "network-vif-deleted", "tag": "1e3d58e9-548a-4f57-9adf-60940a4391b7"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:53.001298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:53.001298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:53.011858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ab8f1b1c-ffa1-42f0-8cea-16df6d1ded2f req-8993f7fc-6f66-4160-80a5-58f3a38e78ff service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.012221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ab8f1b1c-ffa1-42f0-8cea-16df6d1ded2f req-8993f7fc-6f66-4160-80a5-58f3a38e78ff service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.030379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-ab8f1b1c-ffa1-42f0-8cea-16df6d1ded2f req-8993f7fc-6f66-4160-80a5-58f3a38e78ff service nova] Creating event network-vif-deleted:1e3d58e9-548a-4f57-9adf-60940a4391b7 for instance 9953c737-dccb-4150-a5e9-6717bbb4d2b8 on hv-cinder-68948 May 13 16:27:53.036002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-ab8f1b1c-ffa1-42f0-8cea-16df6d1ded2f req-8993f7fc-6f66-4160-80a5-58f3a38e78ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042335 May 13 16:27:53.037379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 420/785] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:53.475179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:53.477409 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:53.492153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.493059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.495095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.495805 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.724491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:53.725251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: 1ddf1269-b8cb-46b2-ba2c-e02abc16df28] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:53.733730 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:53.734001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.734693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.735501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.735953 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.742893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:53.744967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:53.746122 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-34705945-0c91-4dc2-8a13-fd4e938a61a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1743 microversion: 2.20 time: 0.274915 May 13 16:27:53.746894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 366/786] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:53 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:53.784933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] HTTP exception thrown: Instance 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 could not be found. May 13 16:27:53.785578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Returning 404 to user: Instance 1ddf1269-b8cb-46b2-ba2c-e02abc16df28 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:53.786430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ef061c10-cf97-4459-876f-e64eb85dfda8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28" status: 404 len: 111 microversion: 2.1 time: 0.066342 May 13 16:27:53.787218 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 421/787] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:53 2021] GET /compute/v2.1/servers/1ddf1269-b8cb-46b2-ba2c-e02abc16df28 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:27:53.795552 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:53.796054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:53.803329 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.803775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.804542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:53.804977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:53.867977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:54.099177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:54.099177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:54.099177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.099177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.100825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.100825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.194933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.195396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.195849 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid 9953c737-dccb-4150-a5e9-6717bbb4d2b8 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:54.252845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:54.263163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-eea5ddfd-66ae-4c3b-bb99-0679a2861c5c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 200 len: 1308 microversion: 2.1 time: 0.305460 May 13 16:27:54.263749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 422/788] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:53 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:54.342032 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-35560973-36b9-48b2-99b0-899483156f4d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 204 len: 0 microversion: 2.1 time: 0.550462 May 13 16:27:54.342951 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 367/789] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:53 2021] DELETE /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:54.350902 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:54.351521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:54.359782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.360323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.361199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.361724 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.582857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:54.595877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d120b54e-5b54-44e3-820e-dbc6be640d73 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.248084 May 13 16:27:54.606319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 423/790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:54 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:54.764405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:54.765130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:54.772276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.772732 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.773557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:54.773994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:54.979411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:54.988061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:54.989937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:54.991156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2fbe13f1-1a11-46ca-99a2-d8629760582c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1743 microversion: 2.20 time: 0.231055 May 13 16:27:54.991716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 368/791] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:54 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:55.283516 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:55.284142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 9953c737-dccb-4150-a5e9-6717bbb4d2b8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:55.291657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.301546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.301546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.301546 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.345135 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Instance 9953c737-dccb-4150-a5e9-6717bbb4d2b8 could not be found. May 13 16:27:55.345748 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 404 to user: Instance 9953c737-dccb-4150-a5e9-6717bbb4d2b8 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:27:55.346582 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fc67a158-ac73-4fed-8cc5-61c40f7105cd tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8" status: 404 len: 111 microversion: 2.1 time: 0.066892 May 13 16:27:55.347158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 424/792] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:55 2021] GET /compute/v2.1/servers/9953c737-dccb-4150-a5e9-6717bbb4d2b8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:27:55.357892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:55.358400 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:55.371508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.372220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.373144 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.373520 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.604880 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:27:55.618435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:55.620171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:55.650448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.651384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.652413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.652864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.895907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:55.910594 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-edfa8bfd-9177-42a0-931e-bda8f90bef3e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.299572 May 13 16:27:55.911351 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 425/793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:55 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:55.919221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:55.919759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:55.927610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.928052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:55.928889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:55.929366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.009697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4fafaaf7-ee15-4c71-8bd4-5d2dba056c62 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 204 len: 0 microversion: 2.1 time: 0.653415 May 13 16:27:56.009697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 369/794] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:27:55 2021] DELETE /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:27:56.016018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:56.016720 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:56.024222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.024676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.026178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.026627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.114002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lazy-loading 'services' on Instance uuid a6a407d6-bb90-4453-84b9-c2974222a3c1 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:27:56.323625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:56.333043 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:56.334879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:56.336426 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-33580e77-7815-4ded-9f8c-b4c1d0b74e14 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.324972 May 13 16:27:56.337034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 370/795] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:56 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:56.351875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:56.352504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:56.360919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.361596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.362424 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.362862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.429441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-271edba9-fdd0-4390-9c95-8f38f4de1f78 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-volume_attachments/f67fc3f1-9ed0-45cd-8ffc-c511c2466771" status: 202 len: 0 microversion: 2.1 time: 0.516436 May 13 16:27:56.430606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 426/796] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:27:55 2021] DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/os-volume_attachments/f67fc3f1-9ed0-45cd-8ffc-c511c2466771 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:27:56.556105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-f3333561-6987-4f2c-aeae-1690e3cd14c6 req-875f59b6-d38d-42af-a30e-383d12a0eefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "name": "network-vif-plugged", "status": "completed", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:27:56.558273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:27:56.558273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:27:56.583456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-f3333561-6987-4f2c-aeae-1690e3cd14c6 req-875f59b6-d38d-42af-a30e-383d12a0eefa service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.584053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-f3333561-6987-4f2c-aeae-1690e3cd14c6 req-875f59b6-d38d-42af-a30e-383d12a0eefa service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.618399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-f3333561-6987-4f2c-aeae-1690e3cd14c6 req-875f59b6-d38d-42af-a30e-383d12a0eefa service nova] Creating event network-vif-plugged:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:27:56.624737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-f3333561-6987-4f2c-aeae-1690e3cd14c6 req-875f59b6-d38d-42af-a30e-383d12a0eefa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073076 May 13 16:27:56.627537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 427/797] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:27:56.780446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:56.791592 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-67e697e0-33a5-4d01-b088-7cf8b9626780 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1513 microversion: 2.1 time: 0.451923 May 13 16:27:56.792440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 371/798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:56 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:56.931160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:56.932989 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:56.941362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.942288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:56.947570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:56.948333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:57.187751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:57.197697 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6d01dace-f0cc-4a9c-931a-0973da3cfb67 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.271458 May 13 16:27:57.204207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 428/799] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:56 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:27:57.367527 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:57.370509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:57.386190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:57.387393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:57.389105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:57.390130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:57.645863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:57.658309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:57.660321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:57.661857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-608f6fe5-89b5-4fcc-9a0d-f97a81ce09fc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.301388 May 13 16:27:57.662743 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 372/800] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:57 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:57.819347 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:57.819967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:57.831352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:57.838248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:57.838248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:57.838248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:58.128450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:58.145601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-002abcb1-3ca0-4ca5-81a5-afec06328b7e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1513 microversion: 2.1 time: 0.331492 May 13 16:27:58.146269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 429/801] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:57 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:58.216518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:58.217530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:58.225613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:58.226439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:58.228811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:58.229568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:58.479565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:58.488927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-520f38ff-194f-40b3-8f26-61d376dd2076 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.277182 May 13 16:27:58.493045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 373/802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:58 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:58.701204 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:58.707063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:58.716998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:58.717806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:58.719240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:58.720027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:59.167739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:59.168824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:59.192809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:59.214718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:59.220737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:59.224389 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:59.229913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:59.257224 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:59.272768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:59.283301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-31947bf2-efb5-42c1-b602-53111199aef9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.598094 May 13 16:27:59.293264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 430/803] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:27:58 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:27:59.505797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:27:59.506847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:27:59.522063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:59.522623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:59.523509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:27:59.524022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:27:59.735143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:59.754415 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9bac590a-bda9-4b86-a3b0-9cdf0d9d6809 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1513 microversion: 2.1 time: 0.587917 May 13 16:27:59.755650 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 374/804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:59 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:27:59.853362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:27:59.863097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-33a348d9-fc54-43b7-9afb-2d4f871a40f4 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.360857 May 13 16:27:59.863735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 431/805] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:27:59 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:00.326983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:00.327815 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:00.343686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.344148 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.345188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.345640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.609542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:00.622286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:00.624480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:00.627715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9d383b97-435f-48ee-8407-773ca727540b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.305413 May 13 16:28:00.628858 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 375/806] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:00 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:00.765751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-1d63ace9-120c-473f-b6f6-1ebb13354904 req-304a1023-443d-4ed5-8888-d90698db3241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5776983-7618-42a1-a71f-f0ed5336525f", "name": "network-vif-deleted", "tag": "d48752e7-15bf-45ed-b9fc-25fe3dece5b5"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:00.768425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:00.768425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:28:00.772398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:00.773883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:00.782374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-1d63ace9-120c-473f-b6f6-1ebb13354904 req-304a1023-443d-4ed5-8888-d90698db3241 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.783105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-1d63ace9-120c-473f-b6f6-1ebb13354904 req-304a1023-443d-4ed5-8888-d90698db3241 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.791979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.794635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.803259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.803892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-1d63ace9-120c-473f-b6f6-1ebb13354904 req-304a1023-443d-4ed5-8888-d90698db3241 service nova] Creating event network-vif-deleted:d48752e7-15bf-45ed-b9fc-25fe3dece5b5 for instance c5776983-7618-42a1-a71f-f0ed5336525f on hv-cinder-68948 May 13 16:28:00.807523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.809850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-1d63ace9-120c-473f-b6f6-1ebb13354904 req-304a1023-443d-4ed5-8888-d90698db3241 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048635 May 13 16:28:00.810875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 432/807] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:00.883215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:00.884361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:00.901504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.901877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:00.903760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:00.904216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.102722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.116440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8562729a-17ef-47cd-b190-54a8da249841 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1471 microversion: 2.1 time: 0.347969 May 13 16:28:01.126085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 376/808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:00 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:01.208462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.227889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cd447a86-8a43-477b-b396-d1e2ed5b177f tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.351444 May 13 16:28:01.234401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 433/809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:00 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:01.272538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9e4d9da4-118c-42ef-963d-409c87c0936b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:01.280107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e4d9da4-118c-42ef-963d-409c87c0936b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:01.280814 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e4d9da4-118c-42ef-963d-409c87c0936b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.342133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9e4d9da4-118c-42ef-963d-409c87c0936b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Going to try to stop instance {{(pid=93649) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 13 16:28:01.646404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:01.647197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:01.654907 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:01.655474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.656378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:01.656817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.676821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9e4d9da4-118c-42ef-963d-409c87c0936b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 202 len: 0 microversion: 2.1 time: 0.407654 May 13 16:28:01.677796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 377/810] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:28:01 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:28:01.703052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:01.704749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:01.717036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:01.717885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.719809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:01.720569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:01.868295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.878412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.879943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.881125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-289b84fa-117f-4291-90d3-4e6901a0f587 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.238560 May 13 16:28:01.892067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 434/811] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:01 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:01.949921 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:01.959283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3327398f-1e56-414c-9817-2ff03bf8ad87 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.276501 May 13 16:28:01.967740 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 378/812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:01 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:02.133171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:02.134062 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:02.141704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.142158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.143142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.143955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.218755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.219223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.219674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:02.245353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:02.246245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:02.254469 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.254917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.256019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.256627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.300464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:02.309711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b3d7ea22-a869-4ca5-9624-ffbf98ff578f tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.180200 May 13 16:28:02.319654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 435/813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:02 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:02.479702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:02.488971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d36c3939-916a-47b9-a8b2-9a0271f87445 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.247365 May 13 16:28:02.489861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 379/814] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:02 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:02.903160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:02.905292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:02.919129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.920505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.922229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.923215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.978000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:02.979356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:02.987160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.987747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:02.989439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:02.989839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.202157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.211976 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.214451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.215621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-00c9e92e-59ef-43c8-a964-cbba4d866d52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.319787 May 13 16:28:03.216185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 436/815] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:02 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:03.317260 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.327498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:03.328725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:03.329602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-27cf5ed3-1bd8-4103-b480-d2443dc2c614 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.354829 May 13 16:28:03.330283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 380/816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:02 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:03.342617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:03.343177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.344116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:03.344717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.427810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:03.428844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.429716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:03.495758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.513340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:03.514165 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:03.524391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6365a8e7-39ac-468f-b689-ae448caad725 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.200640 May 13 16:28:03.524638 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:03.534614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.534905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 437/817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:03 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:03.535022 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:03.535022 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:03.738290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:03.746956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b757b65c-250b-4a90-94b3-b5c450ef535d tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.240694 May 13 16:28:03.747561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 381/818] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:03 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:04.234811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:04.235711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:04.244263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.244871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.245785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.246324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.359563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:04.361006 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:04.371915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.377915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.381010 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.384716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.509658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:04.520516 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:04.522397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:04.523572 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3684eb3b-bc09-40cd-a37b-883586d152f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.292833 May 13 16:28:04.537137 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 438/819] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:04 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:04.544592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:04.545424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:04.553564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.554199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.555116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.555638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.646496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.646870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.647339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:04.711201 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:04.724054 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0e6cafcd-6e8a-4847-94a0-5b2118d6bae6 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.184388 May 13 16:28:04.724742 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 439/820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:04 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:04.733211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:04.747090 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7a5c0541-151b-452d-8e08-14e765e5793a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.400569 May 13 16:28:04.747801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 382/821] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:04 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:04.764580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:04.765327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:04.773598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.775654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:04.775654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:04.775654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.111716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:05.120587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7629647e-ad5e-42d1-885c-5980102a1895 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.359966 May 13 16:28:05.121395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 440/822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:04 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:05.544609 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:05.545564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:05.554022 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.554787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.555864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.556523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.742416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:05.743026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:05.751311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.752012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.752984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.753592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.798642 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:05.809719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:05.811568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:05.812988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9d5f6246-2731-4b91-95d3-e776bf3e297e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.274086 May 13 16:28:05.814030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 383/823] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:05 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:05.824913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:05.826054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:05.835013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.835350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.835757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.836283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.836756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:05.836887 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:05.838511 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:05.900498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:05.909815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-57d015f8-a64a-4c54-91b4-66b4f3d981a8 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.171241 May 13 16:28:05.917631 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 441/824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:05 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:06.091008 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:06.100939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6c865f8b-dcd3-4082-8bee-7f582f1cd482 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.285667 May 13 16:28:06.102282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 384/825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:05 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:06.137288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:06.138149 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:06.146505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.146959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:06.147762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.148220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:06.388822 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:06.398160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3face835-ad02-45f9-8c98-08b87434abe3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.264564 May 13 16:28:06.399071 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 442/826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:06 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:06.832045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:06.832709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:06.840969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.843214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:06.843214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.843214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:06.929447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:06.930293 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:06.938941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.939425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:06.940301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:06.940777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.017949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:07.018406 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.018865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:07.068780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.075264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.078546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.080080 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.081373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-041fb525-6f83-46d8-a09a-bac166000489 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.253518 May 13 16:28:07.082038 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 385/827] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:06 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:07.083996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a6b7cdee-dd9f-4ad4-a849-ff7773b12f74 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.159620 May 13 16:28:07.084564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 443/828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:06 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:07.120839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:07.121508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:07.129708 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:07.130211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.131285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:07.131804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.347879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.361168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-22e5ad02-85c7-4069-b5e1-171d3e045640 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.244824 May 13 16:28:07.362627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 386/829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:07 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:07.416243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:07.416893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:07.424980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:07.425464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.426258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:07.429220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:07.647176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:07.658383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e4eaa22f-5347-4b4c-9d50-10b6f17bccf2 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.245901 May 13 16:28:07.668674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 444/830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:07 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:08.101900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:08.102482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:08.103103 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:08.103752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:08.112546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.113024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.113896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.114351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.120992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.121499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.122321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.122760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.202229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.202595 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.203053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:08.271737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.282491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a85096c7-8cae-454a-b6cd-44f89aa10e4c tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.183875 May 13 16:28:08.283221 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 445/831] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:08 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:08.386350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:08.387174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:08.395256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.395717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.396544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.397013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.435106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.446891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.448549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.449924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bdabe16f-9f2f-4a22-85a0-f0f474bf33c5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.353949 May 13 16:28:08.450584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 387/832] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:08 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:08.641719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.652133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-13cba6ec-14e3-4870-b398-acb51616109b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.269307 May 13 16:28:08.654968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 446/833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:08 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:08.680250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:08.682227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:08.694968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.694968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.695665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:08.696179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:08.927449 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:08.936824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6461950f-cbc7-4a4e-bf9e-921ad8da3267 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.263851 May 13 16:28:08.937749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 388/834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:08 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:09.299733 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:09.300371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:09.307801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.308265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.309056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.309531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.380397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.380857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.381355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid c5776983-7618-42a1-a71f-f0ed5336525f {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:09.438277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:09.447502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-28e600d2-3b0a-410f-a19d-12702490ffbe tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 200 len: 1308 microversion: 2.1 time: 0.150997 May 13 16:28:09.448147 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 447/835] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:09 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:09.468262 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:09.468871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:09.476172 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.476872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.477691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.478127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.671286 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:09.672049 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:09.680815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.680815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.681939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.682601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.684341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:09.693718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:09.695246 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:09.696412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7d21b0f7-8d4e-49a4-8d8a-f757d5d2f475 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1738 microversion: 2.20 time: 0.231882 May 13 16:28:09.697022 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 389/836] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:09 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:09.890356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:09.898940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a4f02825-b5ff-4b9a-b2cd-945f784e8969 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.233019 May 13 16:28:09.899758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 448/837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:09 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:09.954105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:09.954718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:09.962050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.963143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:09.963929 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:09.964362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.174496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:10.184138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b9426813-b597-43d9-a040-69916b1fc2b8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.233988 May 13 16:28:10.184718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 390/838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:09 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:10.463856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:10.464470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: c5776983-7618-42a1-a71f-f0ed5336525f] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:10.472329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.472854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.473868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.474446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.526645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Instance c5776983-7618-42a1-a71f-f0ed5336525f could not be found. May 13 16:28:10.527520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 404 to user: Instance c5776983-7618-42a1-a71f-f0ed5336525f could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:10.528489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d9af13b9-a521-4605-b605-013a9ce2969d tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f" status: 404 len: 111 microversion: 2.1 time: 0.068798 May 13 16:28:10.529555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 449/839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:10 2021] GET /compute/v2.1/servers/c5776983-7618-42a1-a71f-f0ed5336525f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:10.715768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:10.716406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:10.724231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.724679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.725654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.726101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.918349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:10.919531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:10.928362 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.928949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.929887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:10.930403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:10.939253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:10.948696 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:10.950414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:10.951672 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cae874ad-e73b-4903-863c-5093041d7619 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.240333 May 13 16:28:10.952338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 391/840] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:10 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:11.128022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:11.136167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8dcf2bca-788e-4145-bbca-40f43593a76a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.222827 May 13 16:28:11.136730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 450/841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:10 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:11.206767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:11.207382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:11.214606 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:11.215065 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:11.215839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:11.216278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:11.412711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:11.421863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-17c49370-e50a-44e0-8ba9-d67e25c976d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.218697 May 13 16:28:11.422453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 392/842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:11 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:11.787365 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:28:11.787974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:28:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:28:11.969877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:11.970664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:11.978400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:11.978861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:11.979993 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:11.980450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:12.153731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:12.154575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:12.162546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:12.163109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:12.163971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:12.164499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:12.379923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:12.391722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9d05efc9-5547-496b-8773-91d80dd35471 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.242137 May 13 16:28:12.392365 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 393/843] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:12 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:12.440128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:12.440748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:12.448581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:12.449001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:12.449501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:12.450294 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:12.450733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:12.458853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:12.460655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:12.463251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9f51bc37-7d5a-4918-a1aa-33a87a19e15d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.496334 May 13 16:28:12.464341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 451/844] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:11 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:12.650141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:12.658562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e293d2a3-5d0b-4374-bd0d-c5a333d6f219 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.222445 May 13 16:28:12.659139 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 394/845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:12 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:13.409752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:13.410361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:13.417788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.418234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.419017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.419455 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.490946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:13.491683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:13.499481 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.499942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.500831 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.501360 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.627427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:13.638651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-83a81f3a-8533-4088-b239-8e927fd4782c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.232516 May 13 16:28:13.639649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 452/846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:13 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:13.675791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:13.676605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:13.684636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.685308 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.686212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:13.686734 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:13.722806 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:13.732693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:13.734438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:13.735670 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ab14fbca-6c21-4638-9f2b-bfc0db0a41cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.248461 May 13 16:28:13.736233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 395/847] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:13 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:13.897334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:13.905974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ef32e12c-adaa-4f8c-b349-8057f262cdee tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.234299 May 13 16:28:13.916232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 453/848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:13 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:14.656838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:14.657498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:14.664992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:14.666079 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:14.666853 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:14.667290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:14.754248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:14.754883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:14.762337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:14.762803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:14.763619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:14.764066 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:14.969180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:14.979890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:14.981833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:14.987259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a5e7ab1a-8084-4b55-bd74-6a1996b53847 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.232412 May 13 16:28:14.987259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 454/849] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:14 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:14.988612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:14.989305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:14.998054 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:14.998575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:14.999378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.000034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.017297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:15.026722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7e3f6579-409b-4b1a-a547-005d70dabd9d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.373692 May 13 16:28:15.027510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 396/850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:14 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:15.215410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:15.225128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6def464c-4e62-4f98-8d69-dccceec978d3 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.240538 May 13 16:28:15.225801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 455/851] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:14 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:15.255617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:15.256611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:15.264572 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.265039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.265872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.266325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.329336 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:28:15.550971 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-238fa205-ba58-4cf9-8c66-35877c7a909e req-08d6f7b3-2bcb-4eec-9559-b76a5ccbdbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "name": "network-vif-unplugged", "status": "completed", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:15.552698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:15.552698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:28:15.561983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-238fa205-ba58-4cf9-8c66-35877c7a909e req-08d6f7b3-2bcb-4eec-9559-b76a5ccbdbec service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.562624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-238fa205-ba58-4cf9-8c66-35877c7a909e req-08d6f7b3-2bcb-4eec-9559-b76a5ccbdbec service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.579847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-238fa205-ba58-4cf9-8c66-35877c7a909e req-08d6f7b3-2bcb-4eec-9559-b76a5ccbdbec service nova] Creating event network-vif-unplugged:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:28:15.585031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-238fa205-ba58-4cf9-8c66-35877c7a909e req-08d6f7b3-2bcb-4eec-9559-b76a5ccbdbec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038073 May 13 16:28:15.585687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 456/852] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:28:15.726563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-26eaf70c-213a-461e-bbdd-e6d409dbdb84 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 204 len: 0 microversion: 2.1 time: 0.474284 May 13 16:28:15.727321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 397/853] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:28:15 2021] DELETE /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 16:28:15.735824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:15.736531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:15.744745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.745234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.746032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:15.746476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:15.945825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:15.954134 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8502967d-a6c1-4889-bad5-9ef51719af03 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1514 microversion: 2.1 time: 0.222621 May 13 16:28:15.954702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 457/854] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:15 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:16.030310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:16.030310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:16.030310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.030310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.030755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.030755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.043925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:16.044769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:16.052716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.053207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.054017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.054454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.270904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:16.273064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:16.283236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:16.284553 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1c80a1fc-1fea-4cbc-9d69-c527edbd5741 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.244607 May 13 16:28:16.284823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:16.297502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 458/855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:16 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:16.297739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-28052169-968d-429d-96c5-869f7413e4db tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.288405 May 13 16:28:16.297847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:16.297847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:16.298955 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 398/856] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:15 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:16.303326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.303895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.306593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:16.306593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:16.598294 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:16.620398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8eb56d2d-0b58-4d62-9223-e00b54148b6e tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1520 microversion: 2.1 time: 0.333485 May 13 16:28:16.621394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 459/857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:16 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:17.172870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:17.173538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:17.189980 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.190750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.195558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.195558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.305414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:17.306665 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:17.314239 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.314627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.315424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.315866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.496618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.505898 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-22528d35-ac99-4444-a803-6ec076dc0e35 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1514 microversion: 2.1 time: 0.538816 May 13 16:28:17.506945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 399/858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:16 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1514 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:17.513364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:17.519569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:17.524258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.525110 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.526087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.526733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.547545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.557585 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.559197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.560358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a171e23d-9167-4c54-a0f0-f5f50ec5312b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1720 microversion: 2.20 time: 0.260284 May 13 16:28:17.561265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 460/859] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:17 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:17.566410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-fce36fa6-da45-45ec-9d8b-53de7d22a10c req-e5f79910-7561-452f-b31b-87c716ef3b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c7c299-cc4b-4299-b6af-e0b4e21580e4", "name": "network-vif-deleted", "tag": "91e8a7e6-b89b-4740-86a4-9c3ed6143aba"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:17.568461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:17.568461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:28:17.576911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-fce36fa6-da45-45ec-9d8b-53de7d22a10c req-e5f79910-7561-452f-b31b-87c716ef3b1c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.577675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-fce36fa6-da45-45ec-9d8b-53de7d22a10c req-e5f79910-7561-452f-b31b-87c716ef3b1c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.594915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-fce36fa6-da45-45ec-9d8b-53de7d22a10c req-e5f79910-7561-452f-b31b-87c716ef3b1c service nova] Creating event network-vif-deleted:91e8a7e6-b89b-4740-86a4-9c3ed6143aba for instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 on hv-cinder-68948 May 13 16:28:17.600002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-fce36fa6-da45-45ec-9d8b-53de7d22a10c req-e5f79910-7561-452f-b31b-87c716ef3b1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037494 May 13 16:28:17.600628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 461/860] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:17.648952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:17.649751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:17.658206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.658672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.659484 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.659932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.823447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.832104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c9c5eb51-76c0-4bf2-bc82-9b583e8bb667 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.323826 May 13 16:28:17.834094 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 400/861] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:17 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:17.840437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:17.840437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:17.855597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.856061 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.856864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:17.857334 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:17.892027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:17.901777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e66654b0-861e-438b-b63f-cb8b35d5db0c tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1305 microversion: 2.1 time: 0.257429 May 13 16:28:17.909051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 462/862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:17 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1305 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:18.036346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lazy-loading 'services' on Instance uuid 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:18.352424 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-574d1603-0e0d-45b9-9a77-e046205e7bfa tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62/os-volume_attachments/e4815c41-9075-4743-87fa-185f88b1340d" status: 202 len: 0 microversion: 2.1 time: 0.516878 May 13 16:28:18.353483 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 401/863] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:28:17 2021] DELETE /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62/os-volume_attachments/e4815c41-9075-4743-87fa-185f88b1340d => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:28:18.524077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:18.525583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:18.540219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.544009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.547045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.547792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.579832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:18.580861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:18.602415 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.603226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.604813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.605522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.787482 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:18.798550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c0cd4c32-9e8f-45d9-b910-dfa8dd80e7ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1514 microversion: 2.1 time: 0.278846 May 13 16:28:18.808280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 463/864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:18 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:18.856259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:18.856791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:18.864535 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.864996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.865831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.866285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.875427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:18.885314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:18.886870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:18.888020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f81a6acf-9909-4ac8-9dac-66770672e63c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1723 microversion: 2.20 time: 0.313262 May 13 16:28:18.888579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 402/865] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:18 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:18.905945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e798ba58-58a1-45f3-90e7-1730c0c1aac4"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:18.907154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:18.914281 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.914735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:18.916102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:18.916538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.079497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:19.088396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-90760e9f-3122-49df-aa94-afb5d0adb707 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.237022 May 13 16:28:19.093363 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 464/866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:18 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:19.093535 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:19.094280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:19.101846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:19.102300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.103758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:19.104198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.175548 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:19.176000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.176484 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lazy-loading 'fault' on Instance uuid a5c7c299-cc4b-4299-b6af-e0b4e21580e4 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:19.233566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ae4e984ce94a1f8a1fef9bb53f6cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc133c816bd4cc5a3a87f673a4c97d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:19.241969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1d3dff71-80db-43b7-883f-a6b97269ddb8 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 200 len: 1310 microversion: 2.1 time: 0.151963 May 13 16:28:19.246603 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 465/867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:19 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:19.815414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:19.816063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:19.823793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:19.824243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.825026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:19.825485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:19.981097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:19.989598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-52dd0b58-96eb-4392-84e7-11bff830e4ac tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1472 microversion: 2.1 time: 0.178107 May 13 16:28:19.990183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 466/868] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:19 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:20.025729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-0421426e-bf26-45e5-b7e5-d4d23624e436 req-dd01575e-5b77-4572-b7fd-4321743561b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1f5404-fbcb-4bac-88f2-711e68d8e0c1", "name": "network-vif-deleted", "tag": "6dbde7a2-50f1-49cf-b87e-608bd10930b3"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:20.027498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:20.027498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:28:20.035973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-0421426e-bf26-45e5-b7e5-d4d23624e436 req-dd01575e-5b77-4572-b7fd-4321743561b1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.036452 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-0421426e-bf26-45e5-b7e5-d4d23624e436 req-dd01575e-5b77-4572-b7fd-4321743561b1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.053356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-0421426e-bf26-45e5-b7e5-d4d23624e436 req-dd01575e-5b77-4572-b7fd-4321743561b1 service nova] Creating event network-vif-deleted:6dbde7a2-50f1-49cf-b87e-608bd10930b3 for instance 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 on hv-cinder-68948 May 13 16:28:20.058408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-0421426e-bf26-45e5-b7e5-d4d23624e436 req-dd01575e-5b77-4572-b7fd-4321743561b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037050 May 13 16:28:20.059006 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 467/869] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:28:20.108474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:20.109564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:20.118622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.119084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.119867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.120310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.228971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-108d566c-8beb-4c18-abdf-82f7cb0dff59 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.326635 May 13 16:28:20.234290 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 403/870] 10.222.0.42 () {62 vars in 1364 bytes} [Thu May 13 16:28:18 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments => generated 188 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:28:20.262691 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:20.263755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] [instance: a5c7c299-cc4b-4299-b6af-e0b4e21580e4] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:20.272423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.272885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.273757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.274193 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.326584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] HTTP exception thrown: Instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 could not be found. May 13 16:28:20.327197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] Returning 404 to user: Instance a5c7c299-cc4b-4299-b6af-e0b4e21580e4 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:20.328531 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-26c9f8be-fc11-4a27-a79c-a937269e6682 tempest-ServerRescueNegativeTestJSON-1283174772 tempest-ServerRescueNegativeTestJSON-1283174772-project] 10.222.0.42 "GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4" status: 404 len: 111 microversion: 2.1 time: 0.071975 May 13 16:28:20.335224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 404/871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:20 2021] GET /compute/v2.1/servers/a5c7c299-cc4b-4299-b6af-e0b4e21580e4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:20.389370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:20.397996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:20.399181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:20.400019 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bc3fbb83-46c4-417d-b870-d10e28f8dab4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1677 microversion: 2.1 time: 0.295690 May 13 16:28:20.404481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 468/872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:20 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1677 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:20.412085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.412872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.414214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.415462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.738421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:20.738925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:20.747467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.747910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.748707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.749227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.750633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-38031348-83d7-4c47-9435-7cea0c4bb083 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action" status: 202 len: 0 microversion: 2.20 time: 0.357150 May 13 16:28:20.751303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 405/873] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:28:20 2021] POST /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 16:28:20.763221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:20.763845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:20.779041 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.779650 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.780716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:20.781355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:20.814087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:28:21.171480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:21.184181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:21.185965 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:21.187154 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7250abc1-09d5-44dc-9680-8dc84522a14e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1749 microversion: 2.20 time: 0.428167 May 13 16:28:21.187705 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 406/874] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:20 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1749 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:21.192433 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:21.193059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:21.203495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.204558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.205414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.205860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.284338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.284927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.285282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lazy-loading 'fault' on Instance uuid 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:21.364664 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7a66d152-0523-4950-a5c8-f318be18e98a tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 204 len: 0 microversion: 2.1 time: 0.629507 May 13 16:28:21.366027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 469/875] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:28:20 2021] DELETE /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 16:28:21.380843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:21.388835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:21.400120 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.400981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.402617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.402905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.520351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4884755f5b1a48cb8e5ff82429a30a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b851be948d64579ae17b2525d0e84b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:21.537536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-44338019-f645-4993-b112-d9a89282d653 tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 200 len: 1308 microversion: 2.1 time: 0.348498 May 13 16:28:21.538451 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 407/876] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:21 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:21.543770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:21.545711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:21.563724 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.564422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.565415 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:21.569675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:21.741720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:21.756018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-72ca6851-4973-4ea1-a6ad-b05981a06158 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1513 microversion: 2.1 time: 0.380258 May 13 16:28:21.766414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 470/877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:21 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:22.209051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:22.209696 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:22.218864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.219369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.221462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.221934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.223023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:22.234763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cd4e5adc-58c1-43db-b5c9-2c45719e61be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1654 microversion: 2.1 time: 0.695020 May 13 16:28:22.248536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 408/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:21 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1654 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:22.253932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d90d70d3-265a-40c7-a530-33777c681ea1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:22.263149 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d90d70d3-265a-40c7-a530-33777c681ea1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.263698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d90d70d3-265a-40c7-a530-33777c681ea1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.322480 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d90d70d3-265a-40c7-a530-33777c681ea1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Going to try to start instance {{(pid=93649) start /opt/stack/nova/nova/compute/api.py:2602}} May 13 16:28:22.445056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:22.459721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:22.461288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:22.463088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0daa8b49-a136-4d5c-a436-be3c15407074 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1749 microversion: 2.20 time: 0.258919 May 13 16:28:22.463651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 471/879] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:22 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:22.561695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d90d70d3-265a-40c7-a530-33777c681ea1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action" status: 202 len: 0 microversion: 2.1 time: 0.311312 May 13 16:28:22.562583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 409/880] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:28:22 2021] POST /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:28:22.572220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:22.573000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] [instance: 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:22.581190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.581897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.582807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:22.582955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.583321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.584421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:22.593300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.593787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.594898 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.595495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.635391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] HTTP exception thrown: Instance 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 could not be found. May 13 16:28:22.636175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] Returning 404 to user: Instance 3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:22.636966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-40e83601-78b2-4685-b0ed-000928ec203e tempest-AttachVolumeNegativeTest-187170957 tempest-AttachVolumeNegativeTest-187170957-project] 10.222.0.42 "GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1" status: 404 len: 111 microversion: 2.1 time: 0.069939 May 13 16:28:22.637760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 472/881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:22 2021] GET /compute/v2.1/servers/3b1f5404-fbcb-4bac-88f2-711e68d8e0c1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:22.773859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:22.774679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:22.783532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.784662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.785788 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:22.786410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:22.992153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:23.003045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-02677673-dc13-4961-bd13-539cce0a6f8e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1663 microversion: 2.1 time: 0.435628 May 13 16:28:23.004095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 410/882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:22 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1663 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:23.167701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:23.183479 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8bdd3e8d-ac7f-4836-a04e-e570a6ae25b2 tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1513 microversion: 2.1 time: 0.413245 May 13 16:28:23.184410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 473/883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:22 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:23.485007 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:23.486425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:23.498144 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:23.498970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:23.500352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:23.501019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:24.021677 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:24.023346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:24.032170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:24.033106 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:24.034060 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:24.034716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:24.129790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:24.132937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:24.135978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:24.137930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dae07e8c-3bf5-4f7e-8089-ee5964c0eadf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1751 microversion: 2.20 time: 0.657503 May 13 16:28:24.148053 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 411/884] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:23 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1751 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:24.214930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:24.215781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:24.229197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:24.229676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:24.230518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:24.231194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:24.367686 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:24.380143 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5c3026e2-cc01-4674-8ac5-6d32e71d26e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1663 microversion: 2.1 time: 0.362164 May 13 16:28:24.381112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 474/885] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:24 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1663 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:24.827786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:24.861509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b4e79162-1617-4112-a2ae-4a6e0e92aced tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1513 microversion: 2.1 time: 0.648928 May 13 16:28:24.869221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 412/886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:24 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:28:25.158610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:25.159219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:25.166721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.167502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.172632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.172632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.336293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-505d7950-3b54-4c26-9173-b2e8925b1a65 req-730d1f3a-dfef-4214-9e78-eb0212b48dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62", "name": "network-vif-deleted", "tag": "154e87c3-b535-4f0a-acb8-3859c36da7a1"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:25.339057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:25.339057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:28:25.346844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-505d7950-3b54-4c26-9173-b2e8925b1a65 req-730d1f3a-dfef-4214-9e78-eb0212b48dfe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.347612 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-505d7950-3b54-4c26-9173-b2e8925b1a65 req-730d1f3a-dfef-4214-9e78-eb0212b48dfe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.365267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-505d7950-3b54-4c26-9173-b2e8925b1a65 req-730d1f3a-dfef-4214-9e78-eb0212b48dfe service nova] Creating event network-vif-deleted:154e87c3-b535-4f0a-acb8-3859c36da7a1 for instance 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 on hv-cinder-68948 May 13 16:28:25.371932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-505d7950-3b54-4c26-9173-b2e8925b1a65 req-730d1f3a-dfef-4214-9e78-eb0212b48dfe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039051 May 13 16:28:25.373046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 413/887] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:28:25.401384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:25.404076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:25.416712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.417209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.418201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.418649 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.479575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:25.489978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:25.491798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:25.493318 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ccda9b3e-0a37-4cb1-a503-fb92d4486191 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1751 microversion: 2.20 time: 0.338579 May 13 16:28:25.505383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 475/888] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:25 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1751 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:25.728203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:25.736883 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-297a86bc-61ca-4369-9468-c32fe81d14cb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1663 microversion: 2.1 time: 0.341667 May 13 16:28:25.737725 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 414/889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:25 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1663 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:25.881550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:25.884437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:25.891885 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.892616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.893740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.894256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.978563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:25.979207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:25.979881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lazy-loading 'fault' on Instance uuid 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:28:26.272769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5adf0abb48b42aaba79305dd79c21ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962a3c5540a24061b68fd96894c59c4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:26.283566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6ab57aa7-4e43-4dd2-87bb-eec855c7850f tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 200 len: 1309 microversion: 2.1 time: 0.405636 May 13 16:28:26.284759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 476/890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:25 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:26.511975 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:26.513288 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:26.522179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:26.522908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:26.534296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:26.534296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:26.770689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:26.781837 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:26.783401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:26.784704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d9a73783-100d-44ec-94da-7127a67c9f36 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.277237 May 13 16:28:26.785298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 415/891] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:26 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:26.790706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:26.791313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:26.799015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:26.799705 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:26.800935 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:26.801578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:26.849674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6cacfd7d-a038-4ad5-ad9a-052b5d58ae49 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Action: 'create', calling method: .version_select at 0x7ffa8cb410d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-847520915"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:27.017192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:27.026557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cdd1aff5-4fe1-4e17-821d-f22950d39243 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1667 microversion: 2.1 time: 0.239836 May 13 16:28:27.027403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 416/892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:26 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1667 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:28:27.302357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:27.303214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] [instance: 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:27.311835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:27.312963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:27.313802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:27.314417 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:27.371674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] HTTP exception thrown: Instance 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 could not be found. May 13 16:28:27.372562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] Returning 404 to user: Instance 8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:27.373718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-676df945-2785-4592-93e9-ca1df52c36df tempest-VolumesSnapshotTestJSON-978688517 tempest-VolumesSnapshotTestJSON-978688517-project] 10.222.0.42 "GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62" status: 404 len: 111 microversion: 2.1 time: 0.075453 May 13 16:28:27.374926 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 417/893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:28:27 2021] GET /compute/v2.1/servers/8e2d8a3e-f61d-4fe2-a0df-bc25feb2cb62 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:28:27.708836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6cacfd7d-a038-4ad5-ad9a-052b5d58ae49 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.008938 May 13 16:28:27.708836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 477/894] 10.222.0.42 () {60 vars in 1155 bytes} [Thu May 13 16:28:26 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1011 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 16:28:27.719460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3ed773ee-882c-4622-b07f-7b879a4d8d5d tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8c7513a0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:27.803341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:27.804266 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:27.818439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:27.819156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:27.820117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:27.820614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:27.917702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3ed773ee-882c-4622-b07f-7b879a4d8d5d tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 200 len: 344 microversion: 2.1 time: 0.202627 May 13 16:28:27.918467 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 418/895] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:28:27 2021] GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:28.296095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:28.302391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:28.304411 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:28.306419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-356f0968-203b-406d-a99b-b8e1e5bc3b6a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.506985 May 13 16:28:28.307211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 478/896] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:27 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:28.931593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b94f53bf-7700-45c8-a8b3-79f493eb8c75 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8d35f280>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:29.031554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b94f53bf-7700-45c8-a8b3-79f493eb8c75 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 200 len: 345 microversion: 2.1 time: 0.104960 May 13 16:28:29.032384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 419/897] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:28:28 2021] GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:29.045114 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a87ebc04-c2bf-48ce-af71-b3eacccb868c tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Action: 'create', calling method: .version_select at 0x7ffa7fff10d0>, body: {"snapshot": {"volume_id": "2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1276858692"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:29.326487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:29.327319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:29.341600 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:29.342458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:29.343761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:29.344386 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:29.603507 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:29.618003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:29.622317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:29.626211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-313b7153-990b-412f-8065-8c90bb9ae181 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.305288 May 13 16:28:29.629826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 420/898] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:29 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:29.745800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a87ebc04-c2bf-48ce-af71-b3eacccb868c tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.698301 May 13 16:28:29.745800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 479/899] 10.222.0.42 () {60 vars in 1162 bytes} [Thu May 13 16:28:29 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:29.748891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-955f8e4d-9373-4fb5-94a9-37c4a6d77823 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8d35f940>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:29.810440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-955f8e4d-9373-4fb5-94a9-37c4a6d77823 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.065387 May 13 16:28:29.811188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 421/900] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:29 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:28:29.820817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0605e3ee-7c9c-4baa-8896-baa28f165131 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cba4040>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:29.862537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0605e3ee-7c9c-4baa-8896-baa28f165131 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045307 May 13 16:28:29.863358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 480/901] 10.222.0.42 () {58 vars in 1140 bytes} [Thu May 13 16:28:29 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:29.878421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6b3727dc-4a89-4b5c-b33d-7e509fc88cc0 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8d35f8b0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:29.947911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6b3727dc-4a89-4b5c-b33d-7e509fc88cc0 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.078113 May 13 16:28:29.951317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 422/902] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:29 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:30.647551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:30.648296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:30.656439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:30.657074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:30.657900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:30.658340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:30.944296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:30.944296 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:30.945403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:30.945403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0bcab844-c607-48d0-a918-ce2ef38bc4e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.291359 May 13 16:28:30.945403 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 481/903] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:30 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:30.961117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-085f6e18-33e9-4ae8-9118-58ba644f1f5a tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8c733af0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:31.021378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-085f6e18-33e9-4ae8-9118-58ba644f1f5a tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.064863 May 13 16:28:31.021992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 423/904] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:30 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:31.959751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:31.960500 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:31.972494 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:31.972948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:31.973812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:31.974263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:32.035241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-85623831-cfbe-4683-9bfc-fc2cb7f069d8 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8d35f3a0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:32.099115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-85623831-cfbe-4683-9bfc-fc2cb7f069d8 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.069404 May 13 16:28:32.100227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 424/905] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:32 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:32.258068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:32.270089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:32.271797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:32.273364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c204dbd3-e498-4d6b-b11e-73dc0284d316 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.317440 May 13 16:28:32.274578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 482/906] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:31 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:33.114178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d7806e7d-ca48-4e2a-a645-1888b56b73e1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8d35f040>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:33.175089 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d7806e7d-ca48-4e2a-a645-1888b56b73e1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.065796 May 13 16:28:33.175089 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 425/907] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:33 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:33.297983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:33.300021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:33.308623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:33.309260 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:33.310168 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:33.311051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:33.652959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:33.666094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:33.667861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:33.670796 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1c958b33-84f2-46d4-98a0-415d4419e479 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.378871 May 13 16:28:33.691466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 483/908] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:33 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:34.186444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-51cc0aa2-6881-440b-af63-07614dd181f2 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8c865ee0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:34.248597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-51cc0aa2-6881-440b-af63-07614dd181f2 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 288 microversion: 2.1 time: 0.065783 May 13 16:28:34.249698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 426/909] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:34 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 288 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:28:34.261136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-20787b94-e3b0-43bb-9f06-568f3a683f0f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8c29a700>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:34.699974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:34.701750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:34.712389 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:34.713358 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:34.714403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:34.715073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:34.746279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-20787b94-e3b0-43bb-9f06-568f3a683f0f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 202 len: 0 microversion: 2.1 time: 0.489423 May 13 16:28:34.747370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 484/910] 10.222.0.42 () {58 vars in 1254 bytes} [Thu May 13 16:28:34 2021] DELETE /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:28:34.759820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-df8b3752-45a4-4e57-916b-4505cf9f5422 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cba45e0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:34.833786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-df8b3752-45a4-4e57-916b-4505cf9f5422 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.078315 May 13 16:28:34.835020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 485/911] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:34 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:35.026271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:35.036763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:35.039074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:35.041012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2a34f468-4cde-4a27-8127-da6c493ca55f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.345121 May 13 16:28:35.041482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 427/912] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:34 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:35.849009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9f460239-2e6a-445b-bdd8-be3475076c0a tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cb41ee0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:35.898809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9f460239-2e6a-445b-bdd8-be3475076c0a tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.053158 May 13 16:28:35.903270 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 486/913] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:35 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:36.062547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:36.063447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:36.072699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:36.073074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:36.074185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:36.074684 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:36.396392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:36.407084 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:36.409322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:36.409817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e4f0ceb6-8439-41c7-ad20-45ecb1bf1805 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.352258 May 13 16:28:36.410378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 428/914] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:36 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:36.910651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60485d78-42ea-422e-9dc2-0b3b2ac95ab8 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cba4940>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:36.960215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60485d78-42ea-422e-9dc2-0b3b2ac95ab8 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.053196 May 13 16:28:36.965344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 487/915] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:36 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:37.434757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:37.444778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:37.444778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:37.445361 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:37.446565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:37.447286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:37.902369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:37.912283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:37.919835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:37.919835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-03b22955-ee8b-4176-97b8-c8bf8a7338cd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.485527 May 13 16:28:37.919835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 429/916] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:37 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:37.972190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-23556825-02d8-4e8f-af2c-b68c75f685f1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cc5aa60>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:38.020416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-23556825-02d8-4e8f-af2c-b68c75f685f1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 200 len: 287 microversion: 2.1 time: 0.051812 May 13 16:28:38.021027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 488/917] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:37 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:38.934369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:38.934983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:38.942722 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:38.944014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:38.944014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:38.944554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:39.044699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-976e9508-a888-46f0-b841-51301b9d66a1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa7fff19d0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:39.103751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-976e9508-a888-46f0-b841-51301b9d66a1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] HTTP exception thrown: Snapshot 821a4aa2-f8c1-4f15-91ee-7b2e33da9228 could not be found. May 13 16:28:39.104656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-976e9508-a888-46f0-b841-51301b9d66a1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Returning 404 to user: Snapshot 821a4aa2-f8c1-4f15-91ee-7b2e33da9228 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:39.105786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-976e9508-a888-46f0-b841-51301b9d66a1 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228" status: 404 len: 111 microversion: 2.1 time: 0.076790 May 13 16:28:39.106583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 489/918] 10.222.0.42 () {58 vars in 1251 bytes} [Thu May 13 16:28:39 2021] GET /compute/v2.1/os-snapshots/821a4aa2-f8c1-4f15-91ee-7b2e33da9228 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:28:39.128935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-915bc4e8-2619-4c11-839f-41b82e2ade60 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa7fff10d0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:39.371550 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:39.404339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-915bc4e8-2619-4c11-839f-41b82e2ade60 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 202 len: 0 microversion: 2.1 time: 0.280023 May 13 16:28:39.404790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:39.404893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 490/919] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:28:39 2021] DELETE /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:28:39.404971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:39.404971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9498be66-e75f-4921-b2b0-48bd33520a7d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.472296 May 13 16:28:39.412088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8b8edd34-b9af-42b1-b86b-0c0d670b3f86 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cc5a700>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:39.422354 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 430/920] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:38 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:39.640579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8b8edd34-b9af-42b1-b86b-0c0d670b3f86 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 200 len: 344 microversion: 2.1 time: 0.233056 May 13 16:28:39.645142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 491/921] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:28:39 2021] GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 344 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:40.439748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:40.440608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:40.448069 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:40.448619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:40.449448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:40.449931 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:40.669194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-02e851f4-4ab1-499c-8bb7-31cc1f1e76a6 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8cba4040>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:40.676044 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:40.686794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:40.688699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:40.689992 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2006274b-1c79-40b0-aae5-349647da9ab5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.254179 May 13 16:28:40.690793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 431/922] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:40 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:40.748053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-02e851f4-4ab1-499c-8bb7-31cc1f1e76a6 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] HTTP exception thrown: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. May 13 16:28:40.748654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-02e851f4-4ab1-499c-8bb7-31cc1f1e76a6 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Returning 404 to user: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:40.749506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-02e851f4-4ab1-499c-8bb7-31cc1f1e76a6 tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 404 len: 109 microversion: 2.1 time: 0.096160 May 13 16:28:40.750048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 492/923] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:28:40 2021] GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:40.764133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f3825233-64ac-4a1f-a2a6-43b571753a2f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa8c73c3a0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:40.831807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-f3825233-64ac-4a1f-a2a6-43b571753a2f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] HTTP exception thrown: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. May 13 16:28:40.831807 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f3825233-64ac-4a1f-a2a6-43b571753a2f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Returning 404 to user: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:40.832852 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f3825233-64ac-4a1f-a2a6-43b571753a2f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 404 len: 109 microversion: 2.1 time: 0.072553 May 13 16:28:40.833777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 432/924] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:28:40 2021] DELETE /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:40.843375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a34f5a8-1421-44c7-8033-660c3982cd5f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Calling method '.version_select at 0x7ffa7fff1ca0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:40.906708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-2a34f5a8-1421-44c7-8033-660c3982cd5f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] HTTP exception thrown: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. May 13 16:28:40.907392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a34f5a8-1421-44c7-8033-660c3982cd5f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] Returning 404 to user: Volume 2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:28:40.908237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2a34f5a8-1421-44c7-8033-660c3982cd5f tempest-VolumesSnapshotsTestJSON-191357300 tempest-VolumesSnapshotsTestJSON-191357300-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc" status: 404 len: 109 microversion: 2.1 time: 0.070367 May 13 16:28:40.908785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 493/925] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:28:40 2021] GET /compute/v2.1/os-volumes/2d8732fe-c3e3-4492-ad82-eae6d2f1fdcc => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:28:41.707814 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:41.708444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:41.719226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:41.719621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:41.720423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:41.720865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:42.015881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:42.026948 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:42.028947 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:42.030403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-70a8625e-f824-4249-930a-bbb8fee76405 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.326423 May 13 16:28:42.034976 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 433/926] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:41 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:43.048717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:43.049358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:43.057501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:43.058099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:43.058992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:43.059430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:43.285100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:43.298356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:43.299930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:43.301174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-98c68ecf-f246-41c5-a1fa-c55bb9481734 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.257366 May 13 16:28:43.301900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 494/927] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:43 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:44.320346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:44.322799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:44.330141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:44.330594 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:44.331413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:44.332029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:44.537881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:44.549501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:44.552247 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:44.552442 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b94e157d-a31b-433b-bbab-a70c49b5a952 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.236094 May 13 16:28:44.553320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 434/928] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:44 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:45.571954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:45.572585 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:45.587018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:45.587711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:45.588905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:45.589400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:45.821209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:45.831063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:45.832684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:45.834012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2a0cfd78-af94-49fc-baf2-cc8567ceaa9d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.266446 May 13 16:28:45.834651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 495/929] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:45 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:46.852156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:46.853124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:46.860472 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:46.860923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:46.861763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:46.862204 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:47.099510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:47.110093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:47.111674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:47.112795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ec47c1e6-8059-4a11-86db-6739f01452e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.265292 May 13 16:28:47.113392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 435/930] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:46 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:48.130088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:48.130785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:48.147498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:48.148037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:48.148859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:48.149328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:48.364314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:48.366987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:48.368601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:48.369781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-64ff36e7-54cf-48c9-a480-d1b132b38e2c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.243493 May 13 16:28:48.370336 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 496/931] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:48 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:28:49.390466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:49.392038 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:49.401463 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:49.402028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:49.403002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:49.403604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:49.632075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:49.642596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:49.644125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:49.645319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-052f9ab6-76b8-4253-b77b-527086d3745c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.261003 May 13 16:28:49.645886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 436/932] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:49 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:50.664057 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:50.664670 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:50.672342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:50.673047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:50.673913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:50.674349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:50.885543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:50.908431 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:50.908431 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:50.909761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-59d6034d-3bc3-4916-86c4-cb52125cb3b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.249693 May 13 16:28:50.911213 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 497/933] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:50 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:51.927799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:51.929287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:51.939566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:51.940433 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:51.943375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:51.944141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:52.291845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:52.301945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:52.303501 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:52.304693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-06a013ce-b2b3-4b16-a7ad-9e88733efb7e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.380797 May 13 16:28:52.305291 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 437/934] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:51 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:53.323567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:53.324209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:53.331681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:53.332148 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:53.332943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:53.333418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:53.600853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:53.611754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:53.613453 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:53.614706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5de83a85-6dda-4bd5-b9fe-2b0e26bbedf2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.295511 May 13 16:28:53.615350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 498/935] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:53 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:53.982845 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-34bc48c0-8de8-4491-926f-47284fbe0b17 req-5097cc6d-7c54-496c-b154-6ba8f28482fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "name": "network-vif-plugged", "status": "completed", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:28:53.984523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:28:53.984523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:28:53.994637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-34bc48c0-8de8-4491-926f-47284fbe0b17 req-5097cc6d-7c54-496c-b154-6ba8f28482fe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:53.994793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-34bc48c0-8de8-4491-926f-47284fbe0b17 req-5097cc6d-7c54-496c-b154-6ba8f28482fe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:54.015917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-34bc48c0-8de8-4491-926f-47284fbe0b17 req-5097cc6d-7c54-496c-b154-6ba8f28482fe service nova] Creating event network-vif-plugged:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:28:54.021059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-34bc48c0-8de8-4491-926f-47284fbe0b17 req-5097cc6d-7c54-496c-b154-6ba8f28482fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213392 May 13 16:28:54.021788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 438/936] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:28:54.632930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:54.634271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:54.642290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:54.642714 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:54.643515 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:54.643958 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:54.866963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:54.880954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:54.883832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:54.885476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-602abfb7-dd66-4b31-98ad-668d1e6764c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.256382 May 13 16:28:54.886372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 499/937] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:54 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:55.905331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:55.906016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:55.913704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:55.914996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:55.915928 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:55.916389 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:56.127701 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:56.137374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:56.138819 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:56.139979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1be565f6-d6ab-4e8e-bd9e-ccbbe71f8644 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.239130 May 13 16:28:56.140749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 439/938] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:55 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:57.158790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:57.159398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:57.167467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:57.168804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:57.168804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:57.169119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:57.371269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:57.380681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:57.382247 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:57.383717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3abc5329-8bdc-47d3-acdb-5ad99b5b0834 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.228771 May 13 16:28:57.384293 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 500/939] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:57 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:58.401611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:58.402332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:58.410361 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:58.410821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:58.411617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:58.412062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:58.645216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:58.657371 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:58.658961 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:58.660177 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c1a50db1-7197-4033-bbb8-faf4930a2eb0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.262581 May 13 16:28:58.660985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 440/940] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:58 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:28:59.680740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:28:59.681409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:28:59.688958 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:59.690944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:59.690944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:28:59.690944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:28:59.921556 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:59.931539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:59.933063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:28:59.934229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-414d14ed-7e8a-40c2-916a-e4c242d04d65 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1807 microversion: 2.20 time: 0.258333 May 13 16:28:59.934789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 501/941] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:28:59 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:29:00.953168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:00.953847 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:00.962097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:00.962546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:00.963328 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:00.963783 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:01.162580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:01.171956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:01.173528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:01.174657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-75d521fc-a8af-4943-b607-4499b14c4762 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1794 microversion: 2.20 time: 0.226044 May 13 16:29:01.175222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 441/942] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:00 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1794 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:29:15.194941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:15.196897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:15.207378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:15.209939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:15.211303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:15.211948 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:15.285043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:29:15.760144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0550638a-2cf4-455a-af7d-94967202dc8b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 204 len: 0 microversion: 2.1 time: 0.570258 May 13 16:29:15.760734 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 502/943] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:29:15 2021] DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:29:15.769279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:15.769895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:15.778735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:15.779163 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:15.780110 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:15.780571 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:16.045627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:16.055336 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1d6e19d5-6d65-4da6-89fe-c419f1c12f03 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1673 microversion: 2.1 time: 0.290100 May 13 16:29:16.065343 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 442/944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:15 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:17.072813 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:17.073569 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:17.084103 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:17.084871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:17.086368 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:17.087014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:17.302277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:17.310975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a32923fc-f18c-4bde-b311-ef97c4e4194f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1673 microversion: 2.1 time: 0.242360 May 13 16:29:17.317384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 503/945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:17 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:18.332234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:18.333586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:18.341862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:18.342540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:18.343701 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:18.344556 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:18.587158 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:18.598860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-05c0f767-a2e1-4cf6-9bf8-517d654722b1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1673 microversion: 2.1 time: 0.271499 May 13 16:29:18.600263 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 443/946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:18 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:19.620764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:19.621409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:19.628934 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:19.629428 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:19.631604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:19.631604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:20.376827 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:20.391224 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8d22ca88-b539-4362-9ff6-16fc240ab4c5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1673 microversion: 2.1 time: 0.775095 May 13 16:29:20.402508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 504/947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:19 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1673 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:21.410555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:21.411354 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:21.431445 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:21.432632 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:21.433677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:21.435341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:22.229586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:22.243116 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-abe39440-5a24-4cff-8990-13959d16e24b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1673 microversion: 2.1 time: 0.836543 May 13 16:29:22.243884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 444/948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:21 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1673 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:23.264903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:23.264903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:23.278303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:23.278964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:23.280992 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:23.282412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:23.456077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:23.464786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-03a51d46-f000-4c34-951e-657f52539e00 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1605 microversion: 2.1 time: 0.208606 May 13 16:29:23.466053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 505/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:23 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:23.978138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-f6e98a9e-423f-4968-879e-e3a8de3df838 req-c7e7c98d-e866-4715-aa74-ede117e86820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a407d6-bb90-4453-84b9-c2974222a3c1", "name": "network-vif-deleted", "tag": "9fff021c-19fd-4cb7-855b-b4a5179b6887"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:23.979046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:29:23.979046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:29:23.988774 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-f6e98a9e-423f-4968-879e-e3a8de3df838 req-c7e7c98d-e866-4715-aa74-ede117e86820 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:23.989568 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-f6e98a9e-423f-4968-879e-e3a8de3df838 req-c7e7c98d-e866-4715-aa74-ede117e86820 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:24.009442 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-f6e98a9e-423f-4968-879e-e3a8de3df838 req-c7e7c98d-e866-4715-aa74-ede117e86820 service nova] Creating event network-vif-deleted:9fff021c-19fd-4cb7-855b-b4a5179b6887 for instance a6a407d6-bb90-4453-84b9-c2974222a3c1 on hv-cinder-68948 May 13 16:29:24.018224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-f6e98a9e-423f-4968-879e-e3a8de3df838 req-c7e7c98d-e866-4715-aa74-ede117e86820 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197242 May 13 16:29:24.019595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 445/950] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:29:24.482920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:24.483545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:24.501035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:24.501738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:24.502827 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:24.503480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:24.671996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:24.672454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:24.672949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lazy-loading 'fault' on Instance uuid a6a407d6-bb90-4453-84b9-c2974222a3c1 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:29:24.790614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:24.806527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3bcdd86d-8ece-45ba-a5c9-861f9d0a8638 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 200 len: 1326 microversion: 2.1 time: 0.327261 May 13 16:29:24.807525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 506/951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:24 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 1326 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:25.824528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:25.825283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:25.841767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:25.842229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:25.843044 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:25.843488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:25.930771 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. May 13 16:29:25.941996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:29:25.943241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1451fc39-150e-47d4-8315-a14fe1e85cad tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 404 len: 111 microversion: 2.1 time: 0.122777 May 13 16:29:25.944358 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 446/952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:25 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:29:25.952923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e9b7a125-2024-48de-8633-7e52a245f91c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '.version_select at 0x7ffa8cba4280>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:26.078432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e9b7a125-2024-48de-8633-7e52a245f91c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215245171" status: 202 len: 0 microversion: 2.1 time: 0.129121 May 13 16:29:26.087935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 507/953] 10.222.0.42 () {58 vars in 1218 bytes} [Thu May 13 16:29:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215245171 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:29:27.942314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: .version_select at 0x7ffa8c73cf70>, body: {"keypair": {"name": "tempest-keypair-2002076822"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:27.968260 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:27.972397 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:28.156450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:28.169970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:28.206827 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8379f9b2-7236-4865-bfe1-4346f6e5e16a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.273879 May 13 16:29:28.211326 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 447/954] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 13 16:29:27 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:29.554541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Action: 'create', calling method: .version_select at 0x7ffa8dca3ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1568395761"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:29.587673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:29.592446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for user 78405c5c40f74675b76fc3b44b6da73b and project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:30.109454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:30.114700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for user 78405c5c40f74675b76fc3b44b6da73b and project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:30.133161 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fd942789-1f1a-4dda-a1b3-2b33373ddc40 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.823423 May 13 16:29:30.134129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 508/955] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 13 16:29:29 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:32.008431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1458871627", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbab1dd3-c16a-4a06-aa40-0c41bf95770a"}], "security_groups": [{"name": "tempest-securitygroup--1731316950"}], "key_name": "tempest-keypair-2002076822", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:32.285492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] validate_networks() for [('fbab1dd3-c16a-4a06-aa40-0c41bf95770a', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:29:33.287648 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:29:33.288302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:29:33.288534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:29:33.288949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:29:33.289452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:29:33.297962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:33.298406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:33.299216 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:33.299655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:33.321113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:33.326492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Getting quotas for user 6192e92db22a46b79136f78d013ea788 and project b3b275605a2e4be5a9245ff78f4c7cae. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:33.340747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:29:33.343844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:29:33.566813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d9554901-f0ff-446b-b1af-db4b7da75fcd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.571735 May 13 16:29:33.567710 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 448/956] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:29:31 2021] POST /compute/v2.1/servers => generated 402 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:29:33.578489 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-834854bd-1055-4bb5-9099-deb697aefb94 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:33.579207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-834854bd-1055-4bb5-9099-deb697aefb94 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:33.673499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-834854bd-1055-4bb5-9099-deb697aefb94 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:33.679843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-834854bd-1055-4bb5-9099-deb697aefb94 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1238 microversion: 2.1 time: 0.105164 May 13 16:29:33.680475 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 509/957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:33 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:34.701890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:34.702997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:34.726790 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:34.727891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:34.729411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:34.730297 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:34.931593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:34.941377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a8feae4d-44c0-4498-acfc-fe8eb26876dd tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1242 microversion: 2.1 time: 0.246816 May 13 16:29:34.945245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 449/958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:34 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:35.960667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:35.961745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:35.977397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:35.984240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:35.984240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:35.984240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:36.182605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:36.199521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a6326756-05b1-42cd-85f0-51d7abc14e6b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1298 microversion: 2.1 time: 0.243243 May 13 16:29:36.200209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 510/959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:35 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:29:37.216467 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:37.217115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:37.225301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:37.226001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:37.227021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:37.227621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:37.643189 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:37.652037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-55b00267-3a76-46f5-aef5-8052334ef3bb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.439274 May 13 16:29:37.662259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 450/960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:37 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:38.673076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:38.673818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:38.686253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:38.686712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:38.687519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:38.687964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:38.990233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-8377f41c-8c29-4fb3-a65e-0c48230096be req-923abedd-d9e0-4314-80f3-758a691ed841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6918da-3844-4511-810b-66ef36c43a4d", "tag": "68526381-bce1-46a5-be3c-e9802582800b"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:38.993681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:29:38.993681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:29:39.008649 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-8377f41c-8c29-4fb3-a65e-0c48230096be req-923abedd-d9e0-4314-80f3-758a691ed841 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:39.009130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-8377f41c-8c29-4fb3-a65e-0c48230096be req-923abedd-d9e0-4314-80f3-758a691ed841 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:39.026124 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:39.041902 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dea702e7-9dfe-4f39-aa87-6a1edc4e7101 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.375349 May 13 16:29:39.044324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 511/961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:38 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:39.057756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-8377f41c-8c29-4fb3-a65e-0c48230096be req-923abedd-d9e0-4314-80f3-758a691ed841 service nova] Creating event network-changed:68526381-bce1-46a5-be3c-e9802582800b for instance 0b6918da-3844-4511-810b-66ef36c43a4d on hv-cinder-68948 May 13 16:29:39.067387 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-8377f41c-8c29-4fb3-a65e-0c48230096be req-923abedd-d9e0-4314-80f3-758a691ed841 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084541 May 13 16:29:39.068209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 451/962] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:29:40.060982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:40.062450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:40.072445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:40.073524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:40.074958 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:40.075581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:40.360979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:40.371625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5da3d630-7bf9-46d6-ae93-e70dbb19eb4f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.314815 May 13 16:29:40.377331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 512/963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:40 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:41.392059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:41.394432 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:41.404789 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:41.406330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:41.407968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:41.408485 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:42.155105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:42.164037 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9db961ee-40bf-4939-82bc-587edc810742 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.778052 May 13 16:29:42.174095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 452/964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:41 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:43.016068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:43.016696 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:43.024431 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.024898 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.025784 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.026226 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.096889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f854916f-6edd-46db-8812-4b3973f190ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments/e798ba58-58a1-45f3-90e7-1730c0c1aac4" status: 200 len: 194 microversion: 2.20 time: 0.084715 May 13 16:29:43.097740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 513/965] 10.222.0.42 () {60 vars in 1454 bytes} [Thu May 13 16:29:43 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments/e798ba58-58a1-45f3-90e7-1730c0c1aac4 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:29:43.181828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:43.182733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:43.190539 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.191116 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.192150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.192839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.251929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:43.252650 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:43.260608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.261206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.262074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:43.262614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:43.463104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lazy-loading 'services' on Instance uuid 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:29:43.716251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:43.725825 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-73b2e9e1-aa5f-46e0-a4a4-13aa4f3126e1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.548501 May 13 16:29:43.726413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 453/966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:43 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:43.809732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de227661-6808-441b-8011-82e09aaad7b3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments/e798ba58-58a1-45f3-90e7-1730c0c1aac4" status: 202 len: 0 microversion: 2.20 time: 0.563387 May 13 16:29:43.810786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 514/967] 10.222.0.42 () {60 vars in 1457 bytes} [Thu May 13 16:29:43 2021] DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7/os-volume_attachments/e798ba58-58a1-45f3-90e7-1730c0c1aac4 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 16:29:44.751546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:44.755954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:44.760086 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:44.760843 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:44.761948 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:44.762939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:45.403802 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:45.430209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-07333afd-fd5f-481e-a780-64e608af3c8d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.689064 May 13 16:29:45.431973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 454/968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:44 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:46.304592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:46.305544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:46.331935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:46.332412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:46.333289 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:46.333736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:46.467890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:46.468508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:46.479097 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:46.479561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:46.480421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:46.480986 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:46.655182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:29:46.972525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:46.982416 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a3eb3729-77bd-4776-949d-eb4eb290b530 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.518584 May 13 16:29:46.983793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 455/969] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:46 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:29:47.014818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-04404db7-ad3f-420a-843e-05cebfb7ed87 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 204 len: 0 microversion: 2.20 time: 0.717883 May 13 16:29:47.015411 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 515/970] 10.222.0.42 () {60 vars in 1280 bytes} [Thu May 13 16:29:46 2021] DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 16:29:47.024372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:47.024911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:47.032663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:47.033175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:47.034002 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:47.034630 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:47.257126 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:47.267818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:47.269468 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:47.273959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2c65516d-cb4a-4724-ba62-7fb04d0746f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.250826 May 13 16:29:47.273959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 456/971] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:47 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:29:48.000831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:48.001576 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:48.009709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:48.010175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:48.010961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:48.011607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:48.295634 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:48.297117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:48.307285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:48.308321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:48.309408 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:48.310224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:48.504935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:48.526190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-870b801f-59c1-427f-9b74-95490c22ba79 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.528750 May 13 16:29:48.540681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 516/972] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:47 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:48.554656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-93af06fa-2fb7-4fb0-b62d-7d0dd5407bba req-943ca9be-90d2-4cb7-85a5-ddcf7662cb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6918da-3844-4511-810b-66ef36c43a4d", "name": "network-vif-plugged", "status": "completed", "tag": "68526381-bce1-46a5-be3c-e9802582800b"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:48.558255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:29:48.558255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:29:48.587919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-93af06fa-2fb7-4fb0-b62d-7d0dd5407bba req-943ca9be-90d2-4cb7-85a5-ddcf7662cb86 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:48.589277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-93af06fa-2fb7-4fb0-b62d-7d0dd5407bba req-943ca9be-90d2-4cb7-85a5-ddcf7662cb86 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:48.624140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-93af06fa-2fb7-4fb0-b62d-7d0dd5407bba req-943ca9be-90d2-4cb7-85a5-ddcf7662cb86 service nova] Creating event network-vif-plugged:68526381-bce1-46a5-be3c-e9802582800b for instance 0b6918da-3844-4511-810b-66ef36c43a4d on hv-cinder-68948 May 13 16:29:48.630041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-93af06fa-2fb7-4fb0-b62d-7d0dd5407bba req-943ca9be-90d2-4cb7-85a5-ddcf7662cb86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085923 May 13 16:29:48.637807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 517/973] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:29:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:29:48.682333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:48.694561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:48.696436 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:48.697698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c06d4087-ec6c-4d94-b21e-af402a01abc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.410431 May 13 16:29:48.699490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 457/974] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:48 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:29:49.548886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:49.550441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:49.570239 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:49.571233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:49.572310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:49.572990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:49.716302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:49.717134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:49.726834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:49.727453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:49.728273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:49.728721 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:49.837009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:49.854121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7273d1e-ad3e-4ce4-80e0-04b455e63a21 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.310044 May 13 16:29:49.856955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 518/975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:49 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:50.045159 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:50.065289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:50.067374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:50.089971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5105e908-d334-4aa7-9913-862591e46a98 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.358704 May 13 16:29:50.089971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 458/976] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:49 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:29:50.885551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:50.891774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:50.908588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:50.911511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:50.916420 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:50.918033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:51.413295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:51.424016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8e433146-c2df-4a95-8e98-ddf7b494451c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1364 microversion: 2.1 time: 0.553816 May 13 16:29:51.425438 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 519/977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:50 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1364 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:51.455718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:51.456348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:51.465076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:51.470308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:51.470308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:51.470308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:51.716933 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:51.731357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:51.733488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:51.734679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3c7fff39-f526-4a48-83ef-e1d63fd4a364 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1722 microversion: 2.20 time: 0.643814 May 13 16:29:51.735238 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 459/978] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:51 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1722 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:29:52.448969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:52.450622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:52.473452 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.475250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:52.476402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.477113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:52.755156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:52.756559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:52.764929 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.765443 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:52.766344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.766781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:52.899955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:52.909998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:52.910170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3e2d93b8-f451-4489-a2ad-df7ccebd70e2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1550 microversion: 2.1 time: 0.471659 May 13 16:29:52.910369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 520/979] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:52 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1550 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:29:52.919826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:52.922118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:52.924023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7a5d8c6e-ac11-4df5-a0c0-81059d98d441 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1656 microversion: 2.20 time: 0.172670 May 13 16:29:52.941654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 460/980] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:52 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:29:52.956754 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:52.957300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:52.969011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.969489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:52.970292 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:52.970736 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:53.060219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-a5adaa4a-858b-4166-84e9-55b708b7faa6 req-aacd2d7f-15e9-43c3-8d63-9eb5fc368ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30d89e-b80d-4ed2-ba2b-38830643d9c7", "name": "network-vif-deleted", "tag": "425d7b24-b326-443e-a889-2bafdaa22b27"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:53.062477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:29:53.062477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:29:53.078651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-a5adaa4a-858b-4166-84e9-55b708b7faa6 req-aacd2d7f-15e9-43c3-8d63-9eb5fc368ddd service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:53.079395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-a5adaa4a-858b-4166-84e9-55b708b7faa6 req-aacd2d7f-15e9-43c3-8d63-9eb5fc368ddd service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:53.118121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-a5adaa4a-858b-4166-84e9-55b708b7faa6 req-aacd2d7f-15e9-43c3-8d63-9eb5fc368ddd service nova] Creating event network-vif-deleted:425d7b24-b326-443e-a889-2bafdaa22b27 for instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 on hv-cinder-68948 May 13 16:29:53.132920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-a5adaa4a-858b-4166-84e9-55b708b7faa6 req-aacd2d7f-15e9-43c3-8d63-9eb5fc368ddd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220216 May 13 16:29:53.137580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 521/981] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:29:53.137857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d21e478c-f773-4772-b281-8dd82f74ae4e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195470 May 13 16:29:53.137857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 461/982] 10.222.0.42 () {58 vars in 1275 bytes} [Thu May 13 16:29:52 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:29:53.952050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:53.952050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:53.963525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:53.965334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:53.966402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:53.966868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:54.045034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:54.045624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:54.046279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lazy-loading 'fault' on Instance uuid 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:29:54.338832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:54.352058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:54.354665 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:54.359837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bfa51689-ba8f-471b-9675-f78c79c291e5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 200 len: 1372 microversion: 2.20 time: 0.413595 May 13 16:29:54.365177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 522/983] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:53 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:29:55.048009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:55.049019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:55.057988 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-fabb521b-3f0a-485e-a912-022c13645ccf req-426700f1-09a4-4f24-94e8-b174635b4407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6918da-3844-4511-810b-66ef36c43a4d", "tag": "68526381-bce1-46a5-be3c-e9802582800b"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:55.060442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:29:55.060442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:29:55.063024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:55.063497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:55.064302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:55.070277 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:55.071677 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-fabb521b-3f0a-485e-a912-022c13645ccf req-426700f1-09a4-4f24-94e8-b174635b4407 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:55.072467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-fabb521b-3f0a-485e-a912-022c13645ccf req-426700f1-09a4-4f24-94e8-b174635b4407 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:55.092603 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-fabb521b-3f0a-485e-a912-022c13645ccf req-426700f1-09a4-4f24-94e8-b174635b4407 service nova] Creating event network-changed:68526381-bce1-46a5-be3c-e9802582800b for instance 0b6918da-3844-4511-810b-66ef36c43a4d on hv-cinder-68948 May 13 16:29:55.103941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-fabb521b-3f0a-485e-a912-022c13645ccf req-426700f1-09a4-4f24-94e8-b174635b4407 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050030 May 13 16:29:55.109236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 523/984] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:29:55.246534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c55dda88-d6a8-484e-856e-fac55e21850c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.201938 May 13 16:29:55.247791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 462/985] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:29:55 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:29:55.381269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:55.382451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:55.390669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:55.391416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:55.397039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:55.397039 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:55.447025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. May 13 16:29:55.448019 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:29:55.449329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-832397a5-a8c1-4426-9497-788a53f65016 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 404 len: 111 microversion: 2.20 time: 0.073091 May 13 16:29:55.450487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 524/986] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:29:55 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 16:29:55.460004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-17b28735-cf38-46b1-b25c-1c907358f8d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '.version_select at 0x7ffa8dca5ee0>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:55.562875 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-17b28735-cf38-46b1-b25c-1c907358f8d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358001313" status: 204 len: 0 microversion: 2.20 time: 0.107129 May 13 16:29:55.566259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 463/987] 10.222.0.42 () {60 vars in 1262 bytes} [Thu May 13 16:29:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358001313 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 16:29:56.259731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:56.260701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:56.276878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:56.277368 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:56.278186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:56.278630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:56.489524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8ed84945-0708-4f05-a6d5-8fc69559b94d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.235275 May 13 16:29:56.490989 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 525/988] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:29:56 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:29:56.703834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1026501281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1568395761", "security_groups": [{"name": "tempest-secgroup-smoke-634050492"}], "block_device_mapping_v2": [{"uuid": "aaf5ac66-0899-431b-beec-e39e3fd9bd46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fce931a8-623e-4de8-8c85-53a4453b90f8"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:56.922879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] validate_networks() for [('fce931a8-623e-4de8-8c85-53a4453b90f8', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:29:57.502024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:57.504943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:57.514454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:57.516049 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:57.518555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:57.519087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:57.719400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6a23951d-42d4-40a7-a916-67e42c0661a5 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.221359 May 13 16:29:57.720061 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 526/989] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:29:57 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 16:29:57.926878 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: .version_select at 0x7ffa8c29a5e0>, body: {"keypair": {"name": "tempest-keypair-7941398"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:57.954158 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:29:57.955321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:29:57.956031 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:29:57.956669 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:29:57.957372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:29:57.969496 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:57.970389 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:57.971500 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:57.974588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:57.983118 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:57.988261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:58.004128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:58.009364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for user 78405c5c40f74675b76fc3b44b6da73b and project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:58.124836 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:29:58.127285 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaf5ac66-0899-431b-beec-e39e3fd9bd46',volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:29:58.325732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:29:58.330265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:29:58.348855 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b57c87d4-0f90-446f-9c05-364b323c05a3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2313 microversion: 2.20 time: 0.426244 May 13 16:29:58.349552 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 527/990] 10.222.0.42 () {62 vars in 1199 bytes} [Thu May 13 16:29:57 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 428 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 13 16:29:58.729379 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-eaecaac9-5d49-42b4-a9c2-3de1237a7012 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.029263 May 13 16:29:58.730700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 464/991] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:29:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:29:58.738498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:58.741771 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:58.754564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-54e36ab0-bfd5-48a0-bbb4-596dc9eb0e35 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:58.755192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-54e36ab0-bfd5-48a0-bbb4-596dc9eb0e35 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:58.766355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:58.768421 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:58.785682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:58.787458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:58.912775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-54e36ab0-bfd5-48a0-bbb4-596dc9eb0e35 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:29:58.958245 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a8df4d1c-b2f7-401d-bffb-d9ddcd7de6e4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.230560 May 13 16:29:58.959526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 528/992] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:29:58 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:29:58.965899 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-54e36ab0-bfd5-48a0-bbb4-596dc9eb0e35 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1095 microversion: 2.1 time: 0.223269 May 13 16:29:58.966897 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 465/993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:58 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1095 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:29:59.441297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:29:59.444820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:29:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:29:59.973379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:29:59.976192 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:59.983640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:29:59.984293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:29:59.997936 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:59.998554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:29:59.999356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:29:59.999804 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:00.000584 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:00.002183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:00.003203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:00.004835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:00.167882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-736899df-cd6a-43c4-b33c-3ecf387cb864 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.199164 May 13 16:30:00.168751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 529/994] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:29:59 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:30:00.235152 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:00.244726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-48c30e70-efe1-4b91-8bb1-684f84390d05 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1145 microversion: 2.1 time: 0.264778 May 13 16:30:00.245341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 466/995] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:29:59 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1145 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:01.181170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:01.185065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:01.195967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:01.200649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:01.200649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:01.200649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:01.262106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:01.262720 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:01.271903 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:01.272374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:01.273203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:01.284561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:01.382529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e7c0079d-b8fb-4ebe-826d-abacb174186b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.206758 May 13 16:30:01.383185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 530/996] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:01 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:30:01.519733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:01.537551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cb5726d9-0c8d-48cd-9b08-af1dfe6ca39d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1201 microversion: 2.1 time: 0.278255 May 13 16:30:01.538504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 467/997] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:01 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1201 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:02.400372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:02.408962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:02.409180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1683627345", "imageRef": "de8d90c0-9995-4dac-bf2b-3cc075274562", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed25e872-ac34-48bf-a01b-d439614d260b"}], "security_groups": [{"name": "tempest-securitygroup--1839830104"}], "key_name": "tempest-keypair-7941398", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:02.414803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:02.415528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:02.424524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:02.425279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:02.636223 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4fb07f20-63f7-4f87-8348-2190d6dd768e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 14 microversion: 2.1 time: 0.246103 May 13 16:30:02.636875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 531/998] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:02 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:30:02.643303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:02.644031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:02.662794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:02.663467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:02.664311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:02.664761 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:02.732223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] validate_networks() for [('ed25e872-ac34-48bf-a01b-d439614d260b', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:30:03.037373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:03.059111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6fbdf872-4021-4dcd-849c-758bd9f5c8dd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1211 microversion: 2.1 time: 0.420568 May 13 16:30:03.059725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 532/999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:02 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1211 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:03.647971 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:03.649687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:03.669386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:03.670191 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:03.676104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:03.676104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:03.719818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:30:03.720393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:30:03.720718 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:30:03.721203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:30:03.721632 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:30:03.733583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:03.734346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:03.735357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:03.736091 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:03.760353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:30:03.767267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Getting quotas for user ebd2e046f46941649877e479827383ed and project 9d3765c8e449420cbc3921f5d16d0b3b. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:30:03.781267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:30:03.784419 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8d90c0-9995-4dac-bf2b-3cc075274562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:30:03.887899 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1ab5252f-5fd1-4038-8172-01ba4e66bf2b tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 7202 microversion: 2.1 time: 0.244251 May 13 16:30:03.889119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 533/1000] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:03 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 7202 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:03.956025 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a0a0764e-de2b-4a3f-8c0f-2f4be7ac06ab tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.557923 May 13 16:30:03.963378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 468/1001] 10.222.0.42 () {62 vars in 1188 bytes} [Thu May 13 16:30:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 16:30:03.970524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:03.971536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:04.077484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:04.078112 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:04.086970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:04.088379 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:04.088841 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:04.089637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:04.116669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:04.131275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:04.133694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:04.135108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-450b5fe5-8ac1-4c48-8a16-28fd6983f04b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1279 microversion: 2.20 time: 0.171596 May 13 16:30:04.138279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 534/1002] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:03 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:04.592388 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:04.604762 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-adc30611-94b2-4dc5-ae57-c12113f5e460 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.530962 May 13 16:30:04.605830 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 469/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:04 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:04.900151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:04.901849 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:04.912344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:04.915829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:04.915829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:04.915829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.068861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5569cf3b-8159-403a-a22d-fd37417f501e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 16196 microversion: 2.1 time: 0.167983 May 13 16:30:05.074394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 535/1004] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:04 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 16196 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:05.159371 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:05.165230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:05.185686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:05.186008 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.187229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:05.187839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.336553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:05.347463 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:05.350102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:05.356775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-66616f33-d2b5-4863-908e-8b39dbab20cf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1283 microversion: 2.20 time: 0.197214 May 13 16:30:05.356775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 470/1005] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:05 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:05.622984 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:05.624080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:05.647736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:05.647736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.648531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:05.650183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.654540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-c5e9807e-2530-4001-8588-3c7f350d2ac3 req-6f0b4a63-8ad0-47b0-861c-4b6d060d3917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93dcdf08-2e6a-4702-9d0b-668517b4105b", "tag": "3b03f95d-0f76-4953-8ef6-f8e0c4d437f3"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:05.656482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:05.656482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:30:05.669237 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-c5e9807e-2530-4001-8588-3c7f350d2ac3 req-6f0b4a63-8ad0-47b0-861c-4b6d060d3917 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:05.670062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-c5e9807e-2530-4001-8588-3c7f350d2ac3 req-6f0b4a63-8ad0-47b0-861c-4b6d060d3917 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:05.731490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-c5e9807e-2530-4001-8588-3c7f350d2ac3 req-6f0b4a63-8ad0-47b0-861c-4b6d060d3917 service nova] Creating event network-changed:3b03f95d-0f76-4953-8ef6-f8e0c4d437f3 for instance 93dcdf08-2e6a-4702-9d0b-668517b4105b on hv-cinder-68948 May 13 16:30:05.740405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-c5e9807e-2530-4001-8588-3c7f350d2ac3 req-6f0b4a63-8ad0-47b0-861c-4b6d060d3917 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089263 May 13 16:30:05.743865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 471/1006] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:06.055715 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:06.067080 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3fec48dd-210b-4c1e-8205-e5e877b23dab tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.447690 May 13 16:30:06.069388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 536/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:05 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:06.082914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:06.084554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:06.103697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:06.104421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:06.105414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:06.106050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:06.290287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-499eb42a-b410-4507-a20d-2e1d5dc0e757 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 18498 microversion: 2.1 time: 0.211390 May 13 16:30:06.294423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 472/1008] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:06 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 18498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:06.370160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:06.370889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:06.378704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:06.379459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:06.380954 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:06.381424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:06.556257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:06.569068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:06.571417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:06.573000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cd047131-4f54-45f3-b16d-acbd3259975d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1331 microversion: 2.20 time: 0.206628 May 13 16:30:06.573794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 537/1009] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:06 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1331 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:07.085580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:07.086912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:07.095968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.096780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.098383 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.099373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.302874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:07.304526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:07.322173 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.324390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.330239 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.331005 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.496499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:07.509826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f1ac819e-fdfc-4de4-97d5-b6ba5a801446 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.429317 May 13 16:30:07.510924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 473/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:07 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:07.595098 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:07.595719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:07.600643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7dc82c76-3b60-4821-950c-7be93431984c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 21344 microversion: 2.1 time: 0.301901 May 13 16:30:07.601906 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 538/1011] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:07 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 21344 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:07.608821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.609580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.610574 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:07.611180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:07.970767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:07.980987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:07.982610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:07.983771 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-14ce0efc-33d9-401e-a571-33f9e7cd05fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1337 microversion: 2.20 time: 0.392421 May 13 16:30:07.984586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 474/1012] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:07 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1337 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:08.527560 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:08.528258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:08.536337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:08.537331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:08.538115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:08.538626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:08.612188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:08.613161 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:08.622342 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:08.622784 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:08.627137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:08.627643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:08.788133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-90613681-1570-4e5b-8513-ac49ff7ab98d tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 23228 microversion: 2.1 time: 0.179729 May 13 16:30:08.791781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 475/1013] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:08 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 23228 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:08.829701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:08.839987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7a6f6e90-125d-49d1-aca1-53bf9d3ab5c6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.315749 May 13 16:30:08.841272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 539/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:08 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:09.004728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:09.005752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:09.027136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.027590 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.028384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.028856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.731492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:09.744917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:09.746479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:09.747581 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-86898a70-229a-48a1-a220-d580e61c245e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.748533 May 13 16:30:09.755787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 476/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:08 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:09.799127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:09.800056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:09.808963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.809708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.810908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.811424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.859361 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:09.861332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:09.873573 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.874437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.875512 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:09.876218 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:09.960900 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-95f1b086-2861-49b7-baed-f2373936af1f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 24347 microversion: 2.1 time: 0.165300 May 13 16:30:09.961956 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 540/1016] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:09 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 24347 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:10.420775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:10.432959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ce08c6ba-4fe9-4744-8ef7-9b0314d20029 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.579134 May 13 16:30:10.434562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 477/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:09 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:10.645042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-52caaff4-cffb-4976-a406-7151c1891966 req-dd6bcdca-af9a-4cc9-be12-85c2b195b5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:10.647855 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:10.647855 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:10.668797 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-52caaff4-cffb-4976-a406-7151c1891966 req-dd6bcdca-af9a-4cc9-be12-85c2b195b5ba service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:10.670847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-52caaff4-cffb-4976-a406-7151c1891966 req-dd6bcdca-af9a-4cc9-be12-85c2b195b5ba service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:10.709212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-52caaff4-cffb-4976-a406-7151c1891966 req-dd6bcdca-af9a-4cc9-be12-85c2b195b5ba service nova] Creating event network-changed:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:30:10.737461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-52caaff4-cffb-4976-a406-7151c1891966 req-dd6bcdca-af9a-4cc9-be12-85c2b195b5ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096692 May 13 16:30:10.738764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 541/1018] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:10.766538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:10.767617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:10.785750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:10.787925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:10.788905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:10.789614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:10.976354 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:10.979918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:10.999335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:11.009059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:11.010280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:11.010725 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:11.153487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bf44c21d-5910-4732-a88a-5fcd274eece2 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 26103 microversion: 2.1 time: 0.181730 May 13 16:30:11.154772 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 542/1019] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:10 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 26103 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:11.179367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:11.189226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:11.190671 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:11.191937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-df261f16-412a-4b09-8a4f-4b955ae3f1d4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.429732 May 13 16:30:11.193370 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 478/1020] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:10 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:11.455310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:11.455932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:11.466858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:11.468550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:11.468550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:11.470339 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:11.815065 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:11.827169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-29495e7a-739f-4a4c-b5ff-6da8f2daea48 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.374012 May 13 16:30:11.827892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 543/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:11 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:12.165168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:12.166249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:12.174041 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.174499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:12.175276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.175715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:12.212418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:12.213025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:12.220521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.220990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:12.221937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.222385 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:12.342421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-798220bc-42fb-456e-9973-8a4ccf3dd4ed tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 27336 microversion: 2.1 time: 0.180787 May 13 16:30:12.343215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 479/1022] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:12 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 27336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:12.434835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:12.456966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:12.459479 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:12.460616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f384fa5c-a629-4e16-9573-f02641e2602a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.253684 May 13 16:30:12.471507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 544/1023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:12 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:12.845321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:12.846020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:12.854912 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.855369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:12.856178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:12.856619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:13.158072 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:13.166430 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e8d95f3d-70f1-4dbb-b151-222cb9a73441 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.325325 May 13 16:30:13.167059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 480/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:12 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:13.248239 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'create', calling method: .version_select at 0x7ffa7fe3dc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-388809040"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:13.271182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for project 8903bce27d65496bb95a7263f3f00c38. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:30:13.275163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for user 72d7a514496e4e73845771d76702cbe9 and project 8903bce27d65496bb95a7263f3f00c38. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:30:13.354621 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:13.355720 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:13.363048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:13.363498 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:13.364809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:13.365406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:13.504362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-13bbd427-f2cb-4f5c-b3dd-feca7081c560 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 27760 microversion: 2.1 time: 0.153215 May 13 16:30:13.508551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 481/1025] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:13 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 27760 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:30:13.510123 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:13.510925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:13.518841 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:13.519331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:13.520120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:13.521258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:13.593938 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for project 8903bce27d65496bb95a7263f3f00c38. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:30:13.598165 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for user 72d7a514496e4e73845771d76702cbe9 and project 8903bce27d65496bb95a7263f3f00c38. Resources: {'key_pairs'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:30:13.612209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fed1da80-0554-40e9-b9ee-79bf4a664c4c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.367873 May 13 16:30:13.612825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 545/1026] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 13 16:30:13 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:13.666754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1542116408", "imageRef": "ccc37409-8fb1-4718-a303-b564b521d7d8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-388809040", "networks": [{"uuid": "bc9aa5bb-a644-479a-90ff-98a72b47cef6"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:13.728653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:13.736406 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] validate_networks() for [('bc9aa5bb-a644-479a-90ff-98a72b47cef6', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:30:13.737769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:13.739304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:13.741142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7b6268e0-58ab-4bf0-a410-036762e28207 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.234882 May 13 16:30:13.741711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 482/1027] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:13 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:14.182444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:14.183178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:14.190301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.190757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.191547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.191987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.393370 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:14.402427 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-05ae1f80-5f96-4982-abe1-eb412dd60d50 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.223673 May 13 16:30:14.403008 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 483/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:14 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:14.446401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:30:14.446890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:30:14.447335 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:30:14.447754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:30:14.448206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:30:14.456621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.457074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.457920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.459072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.477672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for project 8903bce27d65496bb95a7263f3f00c38. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:30:14.481755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Getting quotas for user 72d7a514496e4e73845771d76702cbe9 and project 8903bce27d65496bb95a7263f3f00c38. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:30:14.492259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:30:14.494544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccc37409-8fb1-4718-a303-b564b521d7d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:30:14.515793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:14.517189 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:14.526757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.531067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.531067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.531067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.634647 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-36319d93-955b-44ea-bc35-46f4560606bd tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971834 May 13 16:30:14.635222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 546/1029] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:30:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 16:30:14.644690 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-977fd5d1-03df-4d49-875b-7c73cd7e174b tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:14.645340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-977fd5d1-03df-4d49-875b-7c73cd7e174b tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:14.659619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-37ae136a-b942-4bb7-b933-682ab6849d7f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 28181 microversion: 2.1 time: 0.147253 May 13 16:30:14.660579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 484/1030] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:14 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 28181 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:30:14.715940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-977fd5d1-03df-4d49-875b-7c73cd7e174b tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:14.725816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-977fd5d1-03df-4d49-875b-7c73cd7e174b tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1258 microversion: 2.1 time: 0.084679 May 13 16:30:14.726540 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 547/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:14 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:14.760352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:14.761198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:14.769446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.769923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.770788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:14.771232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:14.970949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:14.980248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:14.981892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:14.983070 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d62b2afb-a944-449a-a6c5-98f5a7796879 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.227792 May 13 16:30:14.983628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 485/1032] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:14 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:15.419112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:15.419722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:15.428225 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:15.428621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:15.429436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:15.429880 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:15.637514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:15.646607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e246c05f-0e90-48a3-be29-b903a28a1c09 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.231151 May 13 16:30:15.647188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 548/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:15 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:15.671856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:15.672788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:15.680149 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:15.680558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:15.681411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:15.681861 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:15.742360 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-12d6b60a-02c0-4263-9a66-ecf79a43242c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:15.743018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-12d6b60a-02c0-4263-9a66-ecf79a43242c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:15.814765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-12d6b60a-02c0-4263-9a66-ecf79a43242c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:15.814943 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4fd234af-323f-4d59-b4f2-d548acf82d69 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 28181 microversion: 2.1 time: 0.146604 May 13 16:30:15.815586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 486/1034] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:15 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 28181 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:15.822345 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-12d6b60a-02c0-4263-9a66-ecf79a43242c tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1258 microversion: 2.1 time: 0.083874 May 13 16:30:15.822904 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 549/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:15 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:16.001945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:16.002655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:16.012342 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.012910 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.013816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.014356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.229269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:16.238728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:16.241167 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:16.242107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-80eb95a7-e024-485d-afb6-d29627a421eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.244373 May 13 16:30:16.242674 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 487/1036] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:15 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:16.664272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:16.664876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:16.672542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.672996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.673801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.674287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.826768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:16.827750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:16.835171 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.835625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.836409 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.836844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.875648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:16.883861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-02963f03-4f60-4651-8511-a0d71e4151f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.223927 May 13 16:30:16.884433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 550/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:16 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:16.888894 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:16.889535 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:16.896676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.897163 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.897964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:16.898407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:16.982296 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-cd93aefd-c537-49e4-b53f-8643b02653dc tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 28472 microversion: 2.1 time: 0.159075 May 13 16:30:16.982947 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 488/1038] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:16 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 28472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 16:30:17.015279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:17.024575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a95bc295-bdf5-47a9-a838-28f8329757e1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1310 microversion: 2.1 time: 0.139080 May 13 16:30:17.025386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 551/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:16 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:17.271298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:17.272014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:17.284411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:17.285840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:17.285971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:17.287015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:17.607755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:17.616772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:17.618319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:17.623528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-93b69c70-8cef-40d2-af00-8ec75a3d6a7a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.352947 May 13 16:30:17.623528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 489/1040] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:17 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:17.900796 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:17.901649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:17.909279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:17.909774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:17.910767 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:17.912310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:17.994610 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:17.995558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:18.003084 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.003546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.004351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.004878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.141742 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:18.154405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6305eb4e-6777-4415-9de9-9b3e7f748fa7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 28640 microversion: 2.1 time: 0.163126 May 13 16:30:18.155310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-edd59098-a8ad-4ac2-9d39-cb30214df566 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.258169 May 13 16:30:18.159624 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 490/1041] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:17 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 28640 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:18.179973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 552/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:17 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:18.180138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:18.180138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:18.180138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.180138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.180482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.180482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.637555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:18.638581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:18.648334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.649193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.650337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:18.650791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:18.719997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:18.729505 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bb02af54-32a2-4ceb-9886-5503e26f638a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.571856 May 13 16:30:18.730082 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 491/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:18 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:18.905656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:18.916487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:18.918090 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:18.919177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-db5851e3-e07c-4b29-8158-4b7668b08b52 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.286576 May 13 16:30:18.919732 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 553/1044] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:18 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:19.167099 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:19.168230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:19.176511 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.177656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:19.178473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.178923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:19.187471 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:19.188333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:19.196190 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.196648 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:19.197678 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.198322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:19.403183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:19.411592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ab78ae0a-6f93-499c-b5bc-69b2d384f416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.228219 May 13 16:30:19.412167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 554/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:19 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:19.746633 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:19.747372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:19.755476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.756024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:19.757016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:19.757542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.051255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:20.062052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-610361e8-5b8e-4a59-9439-1c3baf977a17 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.319157 May 13 16:30:20.072228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 555/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:19 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:20.078544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:20.079517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:20.088298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:20.088753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.089580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:20.090027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.314651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:20.325128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:20.326700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:20.327845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f0ffba53-f4f2-4c1d-b0a3-fbbd10b9b999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.254211 May 13 16:30:20.328578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 556/1047] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:20 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:20.372084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-d3375f72-d461-41ea-8dc6-c4e24000dc85 req-718b312d-6ee4-4d5e-af6c-e563dbbc2b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "name": "network-vif-plugged", "status": "completed", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:20.374056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:20.374056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:20.386598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-d3375f72-d461-41ea-8dc6-c4e24000dc85 req-718b312d-6ee4-4d5e-af6c-e563dbbc2b20 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:20.387062 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-d3375f72-d461-41ea-8dc6-c4e24000dc85 req-718b312d-6ee4-4d5e-af6c-e563dbbc2b20 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.404693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-d3375f72-d461-41ea-8dc6-c4e24000dc85 req-718b312d-6ee4-4d5e-af6c-e563dbbc2b20 service nova] Creating event network-vif-plugged:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:30:20.409790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-d3375f72-d461-41ea-8dc6-c4e24000dc85 req-718b312d-6ee4-4d5e-af6c-e563dbbc2b20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041172 May 13 16:30:20.410591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 557/1048] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:30:20.441045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:20.441045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:20.441045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:20.441045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.441785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:20.441785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:20.705218 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:20.714033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6007fc99-b56d-492e-ae9f-0a94c4bb4107 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.289639 May 13 16:30:20.714877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 558/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:20 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:21.079070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:21.079773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:21.088282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.088879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.089718 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.090230 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.402781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:21.412229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-72906b3a-8cd8-4094-baa9-6654cf8b50a9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.336853 May 13 16:30:21.422530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 559/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:21 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:21.422530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:21.422530 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:21.426035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.426493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.427295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.427740 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.648920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:21.658056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:21.659536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:21.660726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c99df778-de9c-40db-a00c-b0993fdfa1c6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.246738 May 13 16:30:21.669144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 560/1051] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:21 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:21.731675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:21.732287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:21.740189 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.740634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.741501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:21.741933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:21.945925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:21.954605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-24094d45-424d-4952-9c0f-045ad9bc1644 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.226569 May 13 16:30:21.963850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 561/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:21 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:22.423626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-6b261812-cde1-466d-80ca-fe0f9780d900 req-8d4f9d4a-b105-4fe5-9b60-618fc60e8c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdf08-2e6a-4702-9d0b-668517b4105b", "name": "network-vif-plugged", "status": "completed", "tag": "3b03f95d-0f76-4953-8ef6-f8e0c4d437f3"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:22.425414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:22.425414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:22.433837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6b261812-cde1-466d-80ca-fe0f9780d900 req-8d4f9d4a-b105-4fe5-9b60-618fc60e8c90 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.434279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6b261812-cde1-466d-80ca-fe0f9780d900 req-8d4f9d4a-b105-4fe5-9b60-618fc60e8c90 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.451288 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-6b261812-cde1-466d-80ca-fe0f9780d900 req-8d4f9d4a-b105-4fe5-9b60-618fc60e8c90 service nova] Creating event network-vif-plugged:3b03f95d-0f76-4953-8ef6-f8e0c4d437f3 for instance 93dcdf08-2e6a-4702-9d0b-668517b4105b on hv-cinder-68948 May 13 16:30:22.456222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-6b261812-cde1-466d-80ca-fe0f9780d900 req-8d4f9d4a-b105-4fe5-9b60-618fc60e8c90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 May 13 16:30:22.456750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 562/1053] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:30:22.462259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:22.463077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:22.471162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.471589 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.472392 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.472833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.707884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:22.716622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4553e74f-ceea-4f6e-80b5-77b89a785aec tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.258617 May 13 16:30:22.717583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 563/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:22 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:22.722248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:22.722937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:22.731782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.732236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.733033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.733559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.941566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:22.950935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:22.952532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:22.953661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-85ddb0cc-fcf8-4994-a33a-d1e5ae5009e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.235277 May 13 16:30:22.954443 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 564/1055] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:22 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:22.971476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:22.972091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:22.980219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.980673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:22.981497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:22.981939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:23.184042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:23.193285 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2d2e9323-a96b-4042-bb5d-fac0cb2e5dd8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.224719 May 13 16:30:23.193910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 565/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:22 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:23.905435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:23.906201 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:23.914712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:23.915189 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:23.916020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:23.916469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:24.130175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:24.138873 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-218a3a29-0dad-4f88-b710-b42fbedbb670 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.407232 May 13 16:30:24.139450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 566/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:23 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:24.144035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:24.144638 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:24.152491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:24.153104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:24.153991 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:24.154518 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:24.362968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:24.372356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:24.373923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:24.375031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4837495d-a5e2-48c3-bd98-e33c48fcdf35 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.234645 May 13 16:30:24.375793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 567/1058] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:24 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:24.380689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:24.381356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:24.388763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:24.391806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:24.391806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:24.391806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:24.599791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:24.608504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1246f191-782e-4424-9693-773626b55186 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.231752 May 13 16:30:24.609095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 568/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:24 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:25.156717 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:25.157559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:25.165702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.166155 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.167024 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.167466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.377063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:25.386206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1a0a3b4f-9399-4707-aa74-591c2a34c99f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.234093 May 13 16:30:25.386786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 569/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:25 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:25.393879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:25.394487 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:25.403676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.404199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.405078 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.405611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.614218 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:25.623526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:25.625237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:25.626358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d0358045-c590-499d-bc7e-aafd27a6acbf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.236800 May 13 16:30:25.626915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 570/1061] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:25 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:25.631869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:25.632475 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:25.640032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.640491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.641388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:25.641832 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:25.850955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:25.860461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f9eae682-2b46-437a-bded-e0834912a1a9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.232471 May 13 16:30:25.861244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 571/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:25 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:26.405866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:26.406744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:26.414743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.415198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:26.415987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.416426 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:26.629380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:26.638736 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-48d3b177-1f6c-4d96-945c-23a69f4de820 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.237171 May 13 16:30:26.648533 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 572/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:26 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:26.653379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:26.653983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:26.662496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.662863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:26.663672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.664107 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:26.872089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:26.881739 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:26.883271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:26.884365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-125e8b8f-4623-4832-a041-765ba55e23c7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.234748 May 13 16:30:26.884927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 573/1064] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:26 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:26.889480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:26.890091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:26.900182 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.900627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:26.901454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:26.901911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:27.100589 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:27.109386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2e593875-6030-44be-96dd-9cac83bc1199 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.223276 May 13 16:30:27.109975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 574/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:26 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:27.665303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:27.666031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:27.673509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:27.673966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:27.674762 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:27.675205 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:27.882925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:27.891140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8ad8bb4b-0154-4d6b-a1e5-85ec309e4a4f tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.229687 May 13 16:30:27.891706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 575/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:27 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:27.902371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:27.902986 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:27.910604 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:27.911563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:27.912361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:27.912805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:28.115752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:28.124850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:28.126412 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:28.127502 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-effa396c-fd72-418c-9f91-15440118dff1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.228861 May 13 16:30:28.128058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 576/1067] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:27 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:28.133939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:28.134752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:28.142634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:28.143086 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:28.143887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:28.144329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:28.443879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:28.452431 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-218a2ae2-8fb0-4fa4-9d46-e74357d121d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.323332 May 13 16:30:28.453016 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 577/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:28 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:28.907790 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:28.908493 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:28.916084 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:28.916562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:28.917492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:28.917932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:29.121405 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:29.129485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2c22d8bc-4c4e-4a06-8b9d-36ca7c4a2cd5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.225370 May 13 16:30:29.130051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 578/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:28 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:29.145864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:29.146477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:29.153735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:29.154194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:29.154977 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:29.155414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:29.351281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:29.359914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:29.361470 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:29.362581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9bd7c01c-e009-46f8-8978-4c1b07309d5b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.220985 May 13 16:30:29.363133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 579/1070] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:29 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:29.469264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:29.469916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:29.478413 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:29.478876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:29.479668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:29.480105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:29.669303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2a3ff626-fcb2-47e8-89a9-567beaea01eb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 37391 microversion: 2.1 time: 10.505581 May 13 16:30:29.671073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 492/1071] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:19 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 37391 bytes in 10508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:29.740672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:29.750364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-da8d219e-a2ea-49eb-a805-6792cd0345cb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.284754 May 13 16:30:29.751264 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 580/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:29 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:30.147616 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:30.148714 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:30.157596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.158080 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.158872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.159306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.379914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:30.387490 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:30.388492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.388932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.389764 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.390210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.438143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:30.446585 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c7678f53-65a5-4897-b0c5-5ceeec670eed tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.303809 May 13 16:30:30.456543 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 493/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:30 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:30.601274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:30.611194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:30.612889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:30.614903 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-98b49897-72f3-4fb8-82e3-ab6df53d1236 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.238986 May 13 16:30:30.616579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 581/1074] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:30 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:30.681857 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:30.682809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:30.690320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.690774 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.691579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.692643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.766685 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:30.767302 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:30.774567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.775025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.775816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:30.776265 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:30.983614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:30.993274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9df13d29-14ef-42e1-9890-098a88c2fb6c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.230074 May 13 16:30:30.993861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 582/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:30 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:31.002334 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-e49e1038-ec4e-4281-bd7b-caa7ffa5ba25 req-74c5d535-3b9a-4983-b439-a5b2719d0472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:31.003962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:31.003962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:31.012914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e49e1038-ec4e-4281-bd7b-caa7ffa5ba25 req-74c5d535-3b9a-4983-b439-a5b2719d0472 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:31.013395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e49e1038-ec4e-4281-bd7b-caa7ffa5ba25 req-74c5d535-3b9a-4983-b439-a5b2719d0472 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:31.030356 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-e49e1038-ec4e-4281-bd7b-caa7ffa5ba25 req-74c5d535-3b9a-4983-b439-a5b2719d0472 service nova] Creating event network-changed:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:30:31.035343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-e49e1038-ec4e-4281-bd7b-caa7ffa5ba25 req-74c5d535-3b9a-4983-b439-a5b2719d0472 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036616 May 13 16:30:31.038402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 583/1076] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:31.122792 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9e770987-6c82-43ec-ad09-be992cb90ae1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 38174 microversion: 2.1 time: 0.444540 May 13 16:30:31.123756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 494/1077] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:30 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 38174 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:31.464483 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:31.465215 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:31.473326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:31.478799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:31.478799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:31.478799 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:31.634311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:31.635016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:31.642757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:31.643198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:31.644080 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:31.644512 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:31.684753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:31.693529 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-069bad71-5550-41d1-980c-2285e0320976 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.233224 May 13 16:30:31.694116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 584/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:31 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:32.010348 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:32.010966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:32.019145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.019602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.020930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.021414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.073560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:32.083934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:32.085557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:32.086613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-86b169a6-2244-4f5c-a38b-da3cd77ef2b5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1405 microversion: 2.20 time: 0.456388 May 13 16:30:32.087363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 495/1079] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:31 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:30:32.137860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:32.139173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:32.150918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.151703 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.152864 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.153551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.332786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:32.341791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3af11968-a0da-4ef7-98ba-01de3e34b851 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1266 microversion: 2.1 time: 0.335018 May 13 16:30:32.342375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 585/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:32 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:32.356871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-61692548-9ea8-4f02-9559-11c933c5a262 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 38174 microversion: 2.1 time: 0.225314 May 13 16:30:32.357557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 496/1081] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:32 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 38174 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:32.710860 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:32.711472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:32.718817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.719275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.720058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:32.720501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:32.917508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:32.925752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f494f6ab-a0f5-4772-b85f-edad2cf8f3d6 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.218705 May 13 16:30:32.926358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 586/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:32 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:33.105415 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:33.106116 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.114024 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.114475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.115258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.115700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.317667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:33.326439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:33.327962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:33.329128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fa01674d-d529-49e4-b5e0-7bbe29c8e35a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1597 microversion: 2.20 time: 0.227931 May 13 16:30:33.329692 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 497/1083] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:30:33 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:30:33.346751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:33.347257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.354929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.355391 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.356188 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.356634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.359158 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:33.359778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.367471 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.367921 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.368711 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.369181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.506947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-524b17ef-2e88-487c-9780-0ae27d516b07 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163986 May 13 16:30:33.507737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 587/1084] 10.222.0.42 () {60 vars in 1316 bytes} [Thu May 13 16:30:33 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:33.512543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:33.513532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.522402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.522866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.523667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.524105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.579095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:33.588579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-decf5235-98a2-4ee6-8d3c-cf767cbc0a22 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1454 microversion: 2.1 time: 0.232978 May 13 16:30:33.589440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 498/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:33 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1454 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:33.605872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:33.606493 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.613929 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.614389 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.615181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.615619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.671371 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fe74227c-7bc8-4bf1-92f9-98fc172abded tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 38187 microversion: 2.1 time: 0.162520 May 13 16:30:33.672587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 588/1086] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:33 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 38187 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:33.813403 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:33.821794 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-587ce42c-dc96-4e09-8c27-fd4480028b51 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1454 microversion: 2.1 time: 0.219572 May 13 16:30:33.822370 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 499/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:33 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:33.943207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:33.943914 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:33.952141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.952595 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:33.953407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:33.953844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:34.302409 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:34.311082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-250fe1fe-988e-4a4d-91c2-b469fb32fd09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.372536 May 13 16:30:34.311754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 589/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:33 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:34.683932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:34.685312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:34.693267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:34.693726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:34.694521 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:34.694968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:34.828644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6c5bf8c3-5eb8-4475-bfa4-8c75fc259f9c tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action" status: 200 len: 38305 microversion: 2.1 time: 0.148443 May 13 16:30:34.830350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 500/1089] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:30:34 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/action => generated 38305 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:30:34.839466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:34.840240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:34.847707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:34.849236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:34.850211 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:34.850669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:34.916361 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2eacf214-9c6f-4f72-98ec-0f1fc7525d51 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/ips" status: 200 len: 146 microversion: 2.1 time: 0.080491 May 13 16:30:34.922276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 590/1090] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:30:34 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/ips => generated 146 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:35.286664 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:35.292496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-e021cff1-4655-4c90-baf0-9351628159e6 req-b980ce19-21d1-47ca-966c-e04d4a687c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:35.293003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:35.293304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:35.293304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:35.296226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:35.296793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:35.297900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:35.298486 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:35.305782 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e021cff1-4655-4c90-baf0-9351628159e6 req-b980ce19-21d1-47ca-966c-e04d4a687c6c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:35.306255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-e021cff1-4655-4c90-baf0-9351628159e6 req-b980ce19-21d1-47ca-966c-e04d4a687c6c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:35.335029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-e021cff1-4655-4c90-baf0-9351628159e6 req-b980ce19-21d1-47ca-966c-e04d4a687c6c service nova] Creating event network-changed:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:30:35.340276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-e021cff1-4655-4c90-baf0-9351628159e6 req-b980ce19-21d1-47ca-966c-e04d4a687c6c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056717 May 13 16:30:35.341404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 591/1091] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:30:35.347481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:35.349466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:35.358477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:35.359348 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:35.360355 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:35.361147 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:35.430536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-721fd7e6-6afd-43e1-8e66-88cd098d9914 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.148635 May 13 16:30:35.432398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 501/1092] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:35 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:35.587675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:35.597352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-be273203-3041-430b-97cd-cbd0c6fef448 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.254477 May 13 16:30:35.598600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 592/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:35 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:36.444068 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:36.445408 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:36.454137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.454617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:36.455600 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.456042 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:36.585361 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fb0efefb-2fcc-4b09-ad3a-43ff1b6505dc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.145788 May 13 16:30:36.586001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 502/1094] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:36 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:36.615404 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:36.616204 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:36.624088 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.624808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:36.625890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.626432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:36.934369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e404ad1e-a9ae-4d0d-824f-3e5391ede44f"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:36.935927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:36.947127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.947664 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:36.948668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:36.949233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:37.050157 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:37.060593 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-37eba39a-7e1c-474e-a9bc-5b300a8dee47 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.449815 May 13 16:30:37.070793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 593/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:36 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:37.601228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-31e8d9dc-c4e2-4546-9a5c-9727cee9add4 req-2346dbac-b894-4e50-94b7-5261da6a437f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93dcdf08-2e6a-4702-9d0b-668517b4105b", "tag": "3b03f95d-0f76-4953-8ef6-f8e0c4d437f3"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:37.602749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:37.602749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:30:37.611418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-31e8d9dc-c4e2-4546-9a5c-9727cee9add4 req-2346dbac-b894-4e50-94b7-5261da6a437f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:37.611874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-31e8d9dc-c4e2-4546-9a5c-9727cee9add4 req-2346dbac-b894-4e50-94b7-5261da6a437f service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:37.628425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-31e8d9dc-c4e2-4546-9a5c-9727cee9add4 req-2346dbac-b894-4e50-94b7-5261da6a437f service nova] Creating event network-changed:3b03f95d-0f76-4953-8ef6-f8e0c4d437f3 for instance 93dcdf08-2e6a-4702-9d0b-668517b4105b on hv-cinder-68948 May 13 16:30:37.634048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-31e8d9dc-c4e2-4546-9a5c-9727cee9add4 req-2346dbac-b894-4e50-94b7-5261da6a437f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037459 May 13 16:30:37.634649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 594/1096] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:37.640219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:37.641253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:37.649674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:37.650131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:37.651046 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:37.651496 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:37.781807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-86890575-c823-4d65-96a7-46c89e1e9b1f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.145380 May 13 16:30:37.782617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 595/1097] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:37 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:37.920319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4f8ee061-f7c8-4edd-879c-730410438ed4 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989883 May 13 16:30:37.920844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 503/1098] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:30:36 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments => generated 194 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:38.079511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:38.080510 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:38.090156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:38.090838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:38.091843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:38.092276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:38.327463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:38.337021 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-145e615d-1a84-46d2-868e-d88fd69f04fe tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.262435 May 13 16:30:38.337721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 596/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:38 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:38.736538 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-31bedbec-7639-4586-ba1c-f6d015331b9c req-068363b1-000b-445b-ac53-e4af6a22d9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "name": "network-vif-plugged", "status": "completed", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:38.738081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:38.738081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:30:38.747661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-31bedbec-7639-4586-ba1c-f6d015331b9c req-068363b1-000b-445b-ac53-e4af6a22d9ba service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:38.748103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-31bedbec-7639-4586-ba1c-f6d015331b9c req-068363b1-000b-445b-ac53-e4af6a22d9ba service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:38.763560 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-31bedbec-7639-4586-ba1c-f6d015331b9c req-068363b1-000b-445b-ac53-e4af6a22d9ba service nova] Creating event network-vif-plugged:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:30:38.768291 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-31bedbec-7639-4586-ba1c-f6d015331b9c req-068363b1-000b-445b-ac53-e4af6a22d9ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036336 May 13 16:30:38.768888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 504/1100] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:30:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:38.792738 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:38.793809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:38.801067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:38.801551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:38.802337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:38.802777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:38.950210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a63f9d62-c885-4fc6-a307-f4018477531a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.160839 May 13 16:30:38.953451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 597/1101] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:38 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:39.355492 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:39.356153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:39.364886 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:39.365648 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:39.377282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:39.377282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:39.562773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:39.571066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dc9284e5-6a11-4924-adf8-df0182bc3778 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.219897 May 13 16:30:39.571630 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 505/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:39 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:39.962675 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:39.963755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:39.971742 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:39.972192 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:39.973416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:39.973857 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:40.100973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7b21602-1a14-49ae-914c-2cb85dc01d6f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.142793 May 13 16:30:40.101653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 598/1103] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:39 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:40.588309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:40.588976 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:40.596377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:40.598909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:40.598909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:40.599211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:40.943107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:40.952616 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5d7f3761-215e-4c37-bbd9-d0b9740e8777 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1358 microversion: 2.1 time: 0.368048 May 13 16:30:40.953239 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 506/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:40 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:41.111870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:41.112871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:41.121556 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.122023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.122813 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.123258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.260881 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-03da091d-f6f2-4c7b-8510-f8ae1fed2433 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.153155 May 13 16:30:41.264018 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 599/1105] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:41 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:41.314197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:41.315168 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:41.322915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.323364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.324134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.324567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.388941 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-574c9716-0879-446d-ab18-ecdc06cf1ca0 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078439 May 13 16:30:41.389522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 507/1106] 10.222.0.42 () {58 vars in 1302 bytes} [Thu May 13 16:30:41 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:41.400375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:41.400964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:41.409199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.409658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.410987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.411432 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.479060 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-12a78692-7cc3-429d-b0f9-45d0dccc771f tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f" status: 200 len: 194 microversion: 2.1 time: 0.083065 May 13 16:30:41.479573 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 600/1107] 10.222.0.42 () {58 vars in 1413 bytes} [Thu May 13 16:30:41 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:41.970000 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:41.970651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:41.978757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.979212 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:41.980191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:41.980473 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.184677 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:42.193544 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f2cbb9c4-9a6a-4759-9575-4c292e6128bc tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1547 microversion: 2.1 time: 0.227264 May 13 16:30:42.194120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 508/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:41 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1547 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:42.210178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:42.210786 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:42.218120 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.218567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.219367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.219800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.272584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:42.273475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:42.280777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.281279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.282074 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.282545 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.419207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:42.424919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-295cb0ad-4662-453a-ad23-948a20f3e9c3 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.156525 May 13 16:30:42.428470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 509/1109] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:42 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:42.428653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-98c54539-4e01-462d-ac63-7044391d66cf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1547 microversion: 2.1 time: 0.221715 May 13 16:30:42.428653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 601/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:42 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:42.444504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:42.448021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:30:42.448021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:30:42.449079 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:42.449838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Searching by: {'deleted': False, 'project_id': '8903bce27d65496bb95a7263f3f00c38'} {{(pid=93649) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 13 16:30:42.455839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.456323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.457825 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.458264 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.552963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.multi_cell_list [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=93649) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 13 16:30:42.643528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-141fda79-879c-4582-9dc8-a140f7eb4a7e tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203865 May 13 16:30:42.644105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 510/1111] 10.222.0.42 () {58 vars in 1125 bytes} [Thu May 13 16:30:42 2021] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:42.654159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:42.654773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:42.662669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.663121 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.663915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:42.664353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:42.861417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:30:42.870283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9856400e-2173-45bf-8ac8-4f149fd5cc41 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1547 microversion: 2.1 time: 0.219856 May 13 16:30:42.870842 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 602/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:30:42 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:43.222063 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e088a3-1b04-456a-99f8-a5b0fc791c6f"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:43.223604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:43.230947 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:43.231402 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:43.232191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:43.232631 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:43.436117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:43.437037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:43.445275 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:43.445801 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:43.446614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:43.447053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:43.603127 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d1a8c22e-ad6e-4db5-80f6-ee59d7de3b43 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.170254 May 13 16:30:43.603800 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 603/1113] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:43 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:44.183499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d85ab3d7-fd00-4090-a449-4a58f5367889 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964878 May 13 16:30:44.184046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 511/1114] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:30:43 2021] POST /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments => generated 194 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:44.614833 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:44.615889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:44.623892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:44.624386 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:44.625216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:44.625663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:44.763698 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-43f7b198-f9b2-4015-8124-b4161f098381 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.152929 May 13 16:30:44.764374 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 604/1115] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:44 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:30:45.063102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3331fa76-038b-4f55-9993-b8de12f8736a"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:45.069003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:45.071669 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:45.072120 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:45.073038 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:45.073562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:45.774945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:45.775982 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:45.784013 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:45.784479 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:45.785303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:45.785755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:45.921944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ee60d9b0-36a0-4f55-9589-4e4293afa13b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 14 microversion: 2.20 time: 0.151003 May 13 16:30:45.922607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 605/1116] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:45 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:30:46.062995 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1e7567f3-00a9-4013-a65e-67179cd1c9e9 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004216 May 13 16:30:46.063549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 512/1117] 10.222.0.42 () {60 vars in 1323 bytes} [Thu May 13 16:30:45 2021] POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:46.933614 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:46.934521 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:46.942923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:46.943373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:46.944148 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:46.944586 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:47.093808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-11ccc63f-3a8b-470e-a509-d6e4097d98df tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 10235 microversion: 2.20 time: 0.164088 May 13 16:30:47.094517 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 606/1118] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:46 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 10235 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:48.107556 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:48.111265 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:48.117908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:48.118363 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:48.119314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:48.119688 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:48.255743 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-21a91ec7-4d70-4967-826e-914a50b3a64e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 16450 microversion: 2.20 time: 0.152778 May 13 16:30:48.256599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 513/1119] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:48 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 16450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:30:49.266892 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:49.267943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:49.275781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:49.276232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:49.277004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:49.277466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:49.423180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b7247c67-2071-442c-87d8-1316716cb9d1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 18305 microversion: 2.20 time: 0.160271 May 13 16:30:49.427456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 607/1120] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:49 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 18305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:30:50.435896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:50.436894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:50.445729 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:50.446231 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:50.447028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:50.447468 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:50.599086 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f13df075-4f72-4dd0-b0d1-e1edf30949ee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 20074 microversion: 2.20 time: 0.167215 May 13 16:30:50.599739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 514/1121] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:50 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 20074 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:51.611393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:51.612390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:51.620552 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:51.621073 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:51.621996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:51.622501 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:51.788314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-efd26f5e-5570-492c-bc8c-924e8d5cb518 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 22107 microversion: 2.20 time: 0.180945 May 13 16:30:51.788949 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 608/1122] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:51 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 22107 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:30:52.800534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:52.802066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:52.810228 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:52.810849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:52.811780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:52.812274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:52.947547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-069b5d36-8647-4898-a197-b8ea298e2da6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 23221 microversion: 2.20 time: 0.151167 May 13 16:30:52.948303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 515/1123] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:52 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 23221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:53.055820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:53.057017 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:53.065000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.065485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.066343 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.066781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.133879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3247e31a-b7f9-47a9-8896-a1e36a406097 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.082270 May 13 16:30:53.134415 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 609/1124] 10.222.0.42 () {58 vars in 1302 bytes} [Thu May 13 16:30:53 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:53.339741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:53.340253 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:53.349372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.349834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.350637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.351087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.415971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-49553b65-9b0f-4441-a7e5-3f33cd7e48ff tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f" status: 200 len: 194 microversion: 2.1 time: 0.080581 May 13 16:30:53.416619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 516/1125] 10.222.0.42 () {58 vars in 1413 bytes} [Thu May 13 16:30:53 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:30:53.426259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:30:53.427811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:53.434300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.434750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.435531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.435968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.597947 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lazy-loading 'services' on Instance uuid 0b6918da-3844-4511-810b-66ef36c43a4d {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:30:53.846856 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-51695375-f8e2-47f6-a5ad-953d28008900 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f" status: 202 len: 0 microversion: 2.1 time: 0.424294 May 13 16:30:53.847807 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 610/1126] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:30:53 2021] DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/e404ad1e-a9ae-4d0d-824f-3e5391ede44f => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:30:53.959317 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:53.960308 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:53.967746 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.968144 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:53.968927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:53.969393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:54.135305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bf368de2-e811-41d7-8842-683dd59b9238 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 24478 microversion: 2.20 time: 0.179589 May 13 16:30:54.135891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 517/1127] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:53 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 24478 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:55.149158 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:55.150170 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:55.157883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:55.158324 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:55.159140 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:55.159562 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:55.309003 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-89c2c1bf-1669-4d58-93de-2724cdc6d953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 25366 microversion: 2.20 time: 0.165208 May 13 16:30:55.310031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 611/1128] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:55 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 25366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:56.321710 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:56.322719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:56.330583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:56.331045 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:56.332322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:56.332769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:56.475828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1cf8f67b-51a7-49d9-84f2-4b66f08260da tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 26456 microversion: 2.20 time: 0.158190 May 13 16:30:56.476756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 518/1129] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:56 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 26456 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:57.488930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:57.489975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:57.498042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:57.498817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:57.499278 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:57.499711 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:57.662341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2dbb3441-dfbc-4bc6-9665-491b1bfeea0f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 27269 microversion: 2.20 time: 0.178015 May 13 16:30:57.663000 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 612/1130] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:57 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 27269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:58.674755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:58.675780 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:58.683716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:58.684163 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:58.684938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:58.685408 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:58.848930 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5a4f5a4d-6cf2-44e5-966a-1e3b30cf0b6c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 27784 microversion: 2.20 time: 0.178052 May 13 16:30:58.849527 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 519/1131] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:58 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 27784 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:30:59.860756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:30:59.861723 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:30:59.870606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:59.871063 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:30:59.871854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:30:59.872378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:00.017508 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d8e06492-0c45-4404-93de-e64f79598fa6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28014 microversion: 2.20 time: 0.160761 May 13 16:31:00.018159 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 613/1132] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:30:59 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28014 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:00.609180 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:00.609884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:00.617906 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:00.618357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:00.619139 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:00.619573 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:00.822904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:00.831617 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ccbd2c2b-2ee2-414f-94c0-beef8a124401 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1593 microversion: 2.1 time: 0.226625 May 13 16:31:00.832698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 520/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:00 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1593 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:01.029511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:01.030408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:01.038439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:01.038895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:01.039731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:01.040177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:01.208547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-60383a40-f27e-4450-96b7-8864b4ccea3d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28198 microversion: 2.20 time: 0.182570 May 13 16:31:01.209536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 614/1134] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:01 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:02.220938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:02.222550 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:02.231712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.232386 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:02.233234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.233676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:02.388638 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-66732c81-8334-4704-a96d-1bb47d7cff5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28198 microversion: 2.20 time: 0.171776 May 13 16:31:02.389319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 521/1135] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:02 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28198 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:02.748167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:02.748805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:02.757611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.758071 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:02.758866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.759313 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:02.826739 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-84f6f298-01e8-47eb-bddf-05dd0166f3be tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/d5e088a3-1b04-456a-99f8-a5b0fc791c6f" status: 200 len: 194 microversion: 2.1 time: 0.082627 May 13 16:31:02.827251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 615/1136] 10.222.0.42 () {58 vars in 1413 bytes} [Thu May 13 16:31:02 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/d5e088a3-1b04-456a-99f8-a5b0fc791c6f => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:31:02.838027 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:02.838620 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:02.846599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.847062 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:02.848156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:02.848593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:03.010653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lazy-loading 'services' on Instance uuid 0b6918da-3844-4511-810b-66ef36c43a4d {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:31:03.351068 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3f097989-ec72-4b5e-8b9c-d548c9609a74 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/d5e088a3-1b04-456a-99f8-a5b0fc791c6f" status: 202 len: 0 microversion: 2.1 time: 0.517449 May 13 16:31:03.351785 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 522/1137] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:31:02 2021] DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d/os-volume_attachments/d5e088a3-1b04-456a-99f8-a5b0fc791c6f => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:03.401563 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:03.402436 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:03.410848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:03.411631 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:03.412543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:03.413220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:03.570478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-15e9b9a3-1788-4b7c-8d00-5653af36f9fa tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28198 microversion: 2.20 time: 0.172793 May 13 16:31:03.571568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 616/1138] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:03 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28198 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:03.871087 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-faa3af3d-1c18-4309-83e9-93e56488741b req-c1954f87-bf51-4ce2-9b11-594881fe979c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:03.872782 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:31:03.872782 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:31:03.882613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-faa3af3d-1c18-4309-83e9-93e56488741b req-c1954f87-bf51-4ce2-9b11-594881fe979c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:03.883406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-faa3af3d-1c18-4309-83e9-93e56488741b req-c1954f87-bf51-4ce2-9b11-594881fe979c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:03.900970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-faa3af3d-1c18-4309-83e9-93e56488741b req-c1954f87-bf51-4ce2-9b11-594881fe979c service nova] Creating event network-changed:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:31:03.905753 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-faa3af3d-1c18-4309-83e9-93e56488741b req-c1954f87-bf51-4ce2-9b11-594881fe979c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038894 May 13 16:31:03.906344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 523/1139] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:31:04.583793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:04.584943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:04.593219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:04.594025 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:04.594818 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:04.595271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:04.750806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f36c0715-e803-4f29-8972-56157e988ead tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28375 microversion: 2.20 time: 0.171858 May 13 16:31:04.752251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 617/1140] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:04 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:05.776716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:05.777766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:05.785109 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:05.785570 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:05.786354 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:05.786795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:05.945137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-915fa60d-d7d2-4787-a3ef-0b90d5843e71 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28489 microversion: 2.20 time: 0.172494 May 13 16:31:05.945785 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 524/1141] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:05 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28489 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:06.018809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:06.019425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:06.027346 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.027804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:06.033577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.033577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:06.092094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:31:06.532544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-566cd318-7b4b-4c03-af87-127625aea7d1 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 204 len: 0 microversion: 2.1 time: 0.517653 May 13 16:31:06.533156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 618/1142] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:31:06 2021] DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:31:06.542686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:06.552693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:06.552693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.552693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:06.553767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.554393 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:06.759382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:06.768280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2cfe43f8-1dab-49a5-a7a4-fdf4cc9592a6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1675 microversion: 2.1 time: 0.230059 May 13 16:31:06.768860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 525/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:06 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:06.956863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:06.958667 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:06.965868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.966326 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:06.967116 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:06.967561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:07.126091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a4af1b02-10dd-48c6-bb42-cc97fa318960 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28657 microversion: 2.20 time: 0.173270 May 13 16:31:07.127007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 619/1144] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:06 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:07.175145 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-883375607"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:07.175693 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:07.183081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:07.183488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:07.184271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:07.184712 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:07.444367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.network.security_group_api [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Adding security group ac237905-6740-4368-9915-e1ef0c7ab3e3 to port 7594a304-140b-4d45-a276-e04edf2da602 May 13 16:31:07.787008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:07.787716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:07.796068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:07.796620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:07.797443 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:07.797876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:07.999274 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:08.006695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-32195bd3-b7f9-48fe-9c82-9e8be3c457a1 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.835252 May 13 16:31:08.007900 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 526/1145] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:31:07 2021] POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:08.016327 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:08.018130 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:08.029603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:08.030727 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-20314be8-6194-4025-a81b-f250383bd19a tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1675 microversion: 2.1 time: 0.248288 May 13 16:31:08.031624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 620/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:07 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1675 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:08.035988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:08.036967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:08.038518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:08.042897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-5171e5c4-0e62-4a23-bb57-a0e3192186f8 req-7a9eca22-3e39-4b15-b34b-d590530b53a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:08.047629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:31:08.047629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:31:08.066011 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-5171e5c4-0e62-4a23-bb57-a0e3192186f8 req-7a9eca22-3e39-4b15-b34b-d590530b53a1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:08.066466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-5171e5c4-0e62-4a23-bb57-a0e3192186f8 req-7a9eca22-3e39-4b15-b34b-d590530b53a1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:08.086970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-5171e5c4-0e62-4a23-bb57-a0e3192186f8 req-7a9eca22-3e39-4b15-b34b-d590530b53a1 service nova] Creating event network-changed:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:31:08.091969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-5171e5c4-0e62-4a23-bb57-a0e3192186f8 req-7a9eca22-3e39-4b15-b34b-d590530b53a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058796 May 13 16:31:08.092606 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 621/1147] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:31:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:31:08.139120 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:08.140120 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:08.149477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:08.150369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:08.151689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:08.152295 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:08.311915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4ede0785-a0fd-4b8f-887d-ae69341be546 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28657 microversion: 2.20 time: 0.176628 May 13 16:31:08.312755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 622/1148] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:08 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28657 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:08.510956 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:08.525176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0f5c2004-1063-47a4-a392-19b9fe406d0a tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1757 microversion: 2.1 time: 0.513240 May 13 16:31:08.527535 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 527/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:08 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1757 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:09.048825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:09.049588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:09.057486 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:09.057952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:09.058735 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:09.059176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:09.257298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:09.265463 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9eab716a-1ee2-4807-b36d-008eeac00d92 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1675 microversion: 2.1 time: 0.220729 May 13 16:31:09.266026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 623/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:09 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:09.325536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:09.326515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:09.334452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:09.334909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:09.335695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:09.336137 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:09.480856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-993615a3-b1ee-47ec-9eb1-846fe4290080 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28657 microversion: 2.20 time: 0.159132 May 13 16:31:09.481554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 528/1151] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:09 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:10.284388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:10.285769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:10.294718 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:10.295169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:10.296023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:10.296460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:10.414168 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:10.422798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-25a70ae6-0eb0-43b0-be4a-fb2d9924fad7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1607 microversion: 2.1 time: 0.142430 May 13 16:31:10.423364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 624/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:10 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1607 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:10.492654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:10.493759 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:10.501844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:10.502394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:10.503274 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:10.503793 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:10.647356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d33040c1-23e1-4c3a-862a-a80aa6ce2ce9 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28657 microversion: 2.20 time: 0.158799 May 13 16:31:10.648014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 529/1153] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:10 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:10.776939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-31263d18-5dce-4620-ae39-d50e08d8b7b5 req-9d443a01-1330-4776-bcab-8698ab009bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6918da-3844-4511-810b-66ef36c43a4d", "name": "network-vif-deleted", "tag": "68526381-bce1-46a5-be3c-e9802582800b"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:10.782759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:31:10.782759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:31:10.794602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-31263d18-5dce-4620-ae39-d50e08d8b7b5 req-9d443a01-1330-4776-bcab-8698ab009bbb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:10.794981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-31263d18-5dce-4620-ae39-d50e08d8b7b5 req-9d443a01-1330-4776-bcab-8698ab009bbb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:10.811290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-31263d18-5dce-4620-ae39-d50e08d8b7b5 req-9d443a01-1330-4776-bcab-8698ab009bbb service nova] Creating event network-vif-deleted:68526381-bce1-46a5-be3c-e9802582800b for instance 0b6918da-3844-4511-810b-66ef36c43a4d on hv-cinder-68948 May 13 16:31:10.816043 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-31263d18-5dce-4620-ae39-d50e08d8b7b5 req-9d443a01-1330-4776-bcab-8698ab009bbb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043557 May 13 16:31:10.817240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 625/1154] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:31:11.440589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:11.442096 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:11.453305 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:11.453768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:11.454575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:11.455071 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:11.526751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:11.527940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:11.528507 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lazy-loading 'fault' on Instance uuid 0b6918da-3844-4511-810b-66ef36c43a4d {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:31:11.661767 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:11.668038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:11.670784 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:11.671387 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:11.672183 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:11.672623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:11.696607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6192e92db22a46b79136f78d013ea788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b275605a2e4be5a9245ff78f4c7cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:11.704904 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4039bbad-fdd5-4fdd-bbed-457179ed2c64 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 200 len: 1328 microversion: 2.1 time: 0.268865 May 13 16:31:11.705778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 530/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:11 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 1328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:11.831497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e9432186-48d6-4620-ad65-fcb1785e41b4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 28991 microversion: 2.20 time: 0.175283 May 13 16:31:11.836844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 626/1156] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:11 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 28991 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:12.722240 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:12.723040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:12.731018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:12.731557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:12.732465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:12.732971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:12.785310 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. May 13 16:31:12.786035 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:12.786816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f6802a36-2a9a-4b4e-adc4-0f2bfd6442f6 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 404 len: 111 microversion: 2.1 time: 0.068710 May 13 16:31:12.787372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 531/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:12 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:12.796548 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-364da77e-2270-4639-bf70-e7dc6c53fbeb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '.version_select at 0x7ffa7fff1c10>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:12.843862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:12.844818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:12.852824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:12.853314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:12.854106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:12.854525 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:12.866649 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-364da77e-2270-4639-bf70-e7dc6c53fbeb tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002076822" status: 202 len: 0 microversion: 2.1 time: 0.074345 May 13 16:31:12.867589 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 627/1158] 10.222.0.42 () {58 vars in 1221 bytes} [Thu May 13 16:31:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002076822 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:13.005186 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-19b4e96a-645d-4269-8135-608bc46037a6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 30556 microversion: 2.20 time: 0.164772 May 13 16:31:13.005858 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 532/1159] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:12 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 30556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:14.017913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:14.018928 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:14.027544 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:14.028002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:14.028792 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:14.029280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:14.166779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de5c49bb-1228-4d4b-bb7c-d4d8b1e2bb8e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 31961 microversion: 2.20 time: 0.153152 May 13 16:31:14.167514 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 628/1160] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:14 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 31961 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:15.179321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:15.180314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:15.188351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:15.188799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:15.189599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:15.190039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:15.330798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3b3b0f3b-2855-4ae2-905b-c83fbd941f76 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 32863 microversion: 2.20 time: 0.156088 May 13 16:31:15.331444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 533/1161] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:15 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 32863 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:16.343427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:16.344506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:16.353076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:16.353600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:16.354427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:16.354870 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:16.497676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-de816d45-78a1-4e9e-9179-32cd5198c7d5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 33584 microversion: 2.20 time: 0.158433 May 13 16:31:16.498370 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 629/1162] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:16 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 33584 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:16.984577 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:16.985185 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:16.993273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:16.993728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:16.994500 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:16.994934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:17.043514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. May 13 16:31:17.044107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:17.044932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-50e2bf42-935a-453e-a332-2edf4deb2ced tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 404 len: 111 microversion: 2.1 time: 0.064576 May 13 16:31:17.045507 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 534/1163] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:31:16 2021] DELETE /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:17.054011 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:17.054712 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: 0b6918da-3844-4511-810b-66ef36c43a4d] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:17.062525 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:17.062979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:17.063755 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:17.064197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:17.113108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. May 13 16:31:17.113710 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance 0b6918da-3844-4511-810b-66ef36c43a4d could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:17.114541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-504a979f-54fa-4290-aa0b-e2a650145e5e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d" status: 404 len: 111 microversion: 2.1 time: 0.064682 May 13 16:31:17.115074 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 630/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:17 2021] GET /compute/v2.1/servers/0b6918da-3844-4511-810b-66ef36c43a4d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:17.510462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:17.511546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:17.520105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:17.520566 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:17.521392 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:17.521843 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:17.666424 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d88cc781-e260-4aae-9648-a191f06cdb0d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 34734 microversion: 2.20 time: 0.159439 May 13 16:31:17.666998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 535/1165] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:17 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 34734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:18.533643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:18.534139 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:18.542449 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.542915 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.543702 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.544148 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.592781 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. May 13 16:31:18.593420 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:18.594262 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ff180ce5-e7c1-4db9-8e99-97f1d2da34f7 tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 404 len: 111 microversion: 2.1 time: 0.064398 May 13 16:31:18.594814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 631/1166] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:31:18 2021] DELETE /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:18.604211 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:18.604917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] [instance: a6a407d6-bb90-4453-84b9-c2974222a3c1] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:18.612824 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.613321 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.614102 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.614547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.663208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] HTTP exception thrown: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. May 13 16:31:18.663813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] Returning 404 to user: Instance a6a407d6-bb90-4453-84b9-c2974222a3c1 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:18.664649 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4cde589d-5b06-426f-a315-27ff0d21922e tempest-AttachVolumeTestJSON-1337537864 tempest-AttachVolumeTestJSON-1337537864-project] 10.222.0.42 "GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1" status: 404 len: 111 microversion: 2.1 time: 0.064636 May 13 16:31:18.665222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 536/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:18 2021] GET /compute/v2.1/servers/a6a407d6-bb90-4453-84b9-c2974222a3c1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:18.677912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:18.679068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:18.686372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.686835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.687623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:18.688069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:18.827925 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-214a6bc2-a69e-4229-964c-ab2d9c8f4903 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 35647 microversion: 2.20 time: 0.153503 May 13 16:31:18.828579 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 632/1168] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:18 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 35647 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:19.839924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:19.840932 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:19.849417 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:19.849877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:19.850663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:19.851104 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:20.000908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bbe2441d-436c-4760-8d52-7734b5db8614 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 36800 microversion: 2.20 time: 0.164646 May 13 16:31:20.001741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 537/1169] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:19 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 36800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:21.013262 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:21.014345 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:21.023064 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:21.023623 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:21.024427 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:21.024882 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:21.168198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5e5d9776-58db-4e19-af0d-51a1bd5bf078 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 37892 microversion: 2.20 time: 0.158980 May 13 16:31:21.170076 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 633/1170] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:21 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 37892 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:22.181224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:22.182151 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:22.190054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:22.190519 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:22.191303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:22.191746 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:22.356951 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dc390e6e-c8f1-4da3-843e-f25315e010f6 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 38212 microversion: 2.20 time: 0.179885 May 13 16:31:22.357913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 538/1171] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:22 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 38212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:23.372528 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:23.372921 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:23.384542 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:23.385012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:23.385865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:23.386469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:23.515550 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cd7957d8-9117-4cee-89bb-1577c04f9740 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 38212 microversion: 2.20 time: 0.149386 May 13 16:31:23.516212 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 634/1172] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:23 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 38212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:24.528248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:24.536360 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:24.537737 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:24.538192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:24.538972 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:24.539407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:24.670767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1c8d215f-9693-4317-9b79-3cda7d220953 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 200 len: 38355 microversion: 2.20 time: 0.146532 May 13 16:31:24.671444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 539/1173] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:24 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 38355 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 13 16:31:24.682105 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:24.682681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:24.690599 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:24.691059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:24.691896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:24.692328 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:24.750455 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8f8caac4-608c-48a4-9c98-fe4366d3d289 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/ips" status: 200 len: 152 microversion: 2.20 time: 0.072574 May 13 16:31:24.751037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 635/1174] 10.222.0.42 () {60 vars in 1289 bytes} [Thu May 13 16:31:24 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:31:26.713858 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d6bd34b7-8069-45ff-bf0d-0de70ff84b49 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Action: 'create', calling method: .version_select at 0x7ffa8c865a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1179668139", "metadata": {"Type": "work"}}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:26.715328 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d6bd34b7-8069-45ff-bf0d-0de70ff84b49 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.716134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d6bd34b7-8069-45ff-bf0d-0de70ff84b49 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121791 May 13 16:31:26.716654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 540/1175] 10.222.0.42 () {60 vars in 1156 bytes} [Thu May 13 16:31:26 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 16:31:26.726243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5e2d175f-87eb-4874-b9a3-73c2dbba7fd8 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Action: 'create', calling method: .version_select at 0x7ffa8cb56670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313722689", "metadata": {"Type": "work"}}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:26.727655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5e2d175f-87eb-4874-b9a3-73c2dbba7fd8 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.728451 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5e2d175f-87eb-4874-b9a3-73c2dbba7fd8 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006563 May 13 16:31:26.728966 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 636/1176] 10.222.0.42 () {60 vars in 1156 bytes} [Thu May 13 16:31:26 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 16:31:26.737368 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1f3304dd-675c-4c27-a645-34ce5b0f6df9 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Action: 'create', calling method: .version_select at 0x7ffa8c8f9c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1077764111", "metadata": {"Type": "work"}}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:26.739034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1f3304dd-675c-4c27-a645-34ce5b0f6df9 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.739821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1f3304dd-675c-4c27-a645-34ce5b0f6df9 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006052 May 13 16:31:26.740335 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 541/1177] 10.222.0.42 () {60 vars in 1156 bytes} [Thu May 13 16:31:26 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 16:31:26.749047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b492c05c-a7ee-49e7-b1e0-266a24656f7f tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Calling method '.version_select at 0x7ffa7fe3d160>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:26.811476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-b492c05c-a7ee-49e7-b1e0-266a24656f7f tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] HTTP exception thrown: Volume tempest-invalid-1779082762 could not be found. May 13 16:31:26.812085 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b492c05c-a7ee-49e7-b1e0-266a24656f7f tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 404 to user: Volume tempest-invalid-1779082762 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.812929 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b492c05c-a7ee-49e7-b1e0-266a24656f7f tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1779082762" status: 404 len: 99 microversion: 2.1 time: 0.067820 May 13 16:31:26.813513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 637/1178] 10.222.0.42 () {58 vars in 1218 bytes} [Thu May 13 16:31:26 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1779082762 => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 13 16:31:26.823792 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-fdf97508-37ce-4d47-8f6e-c2cf9ca62898 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003664 May 13 16:31:26.824289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 542/1179] 10.222.0.42 () {58 vars in 1140 bytes} [Thu May 13 16:31:26 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 16:31:26.832658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-610d5065-71a0-49d4-8a91-b34ce286f6a5 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003661 May 13 16:31:26.833193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 638/1180] 10.222.0.42 () {58 vars in 1137 bytes} [Thu May 13 16:31:26 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 16:31:26.841491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bb6e66c0-aae8-41b0-892a-7f848773b298 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Calling method '.version_select at 0x7ffa8cb3ec10>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:26.905497 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-bb6e66c0-aae8-41b0-892a-7f848773b298 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] HTTP exception thrown: Volume ab8c7281-92a6-4f4f-979b-6feb03dab2c9 could not be found. May 13 16:31:26.906101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bb6e66c0-aae8-41b0-892a-7f848773b298 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 404 to user: Volume ab8c7281-92a6-4f4f-979b-6feb03dab2c9 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.906971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bb6e66c0-aae8-41b0-892a-7f848773b298 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/ab8c7281-92a6-4f4f-979b-6feb03dab2c9" status: 404 len: 109 microversion: 2.1 time: 0.069023 May 13 16:31:26.907522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 543/1181] 10.222.0.42 () {58 vars in 1248 bytes} [Thu May 13 16:31:26 2021] DELETE /compute/v2.1/os-volumes/ab8c7281-92a6-4f4f-979b-6feb03dab2c9 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:26.916462 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-470c2621-cb4c-48bf-89cc-d97e302c6969 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Calling method '.version_select at 0x7ffa8c29ae50>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:26.974864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-470c2621-cb4c-48bf-89cc-d97e302c6969 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] HTTP exception thrown: Volume 178e485f-6f5e-4c06-a480-3b72766c6037 could not be found. May 13 16:31:26.975465 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-470c2621-cb4c-48bf-89cc-d97e302c6969 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] Returning 404 to user: Volume 178e485f-6f5e-4c06-a480-3b72766c6037 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:31:26.976282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-470c2621-cb4c-48bf-89cc-d97e302c6969 tempest-VolumesNegativeTest-251656103 tempest-VolumesNegativeTest-251656103-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/178e485f-6f5e-4c06-a480-3b72766c6037" status: 404 len: 109 microversion: 2.1 time: 0.063568 May 13 16:31:26.976858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 639/1182] 10.222.0.42 () {58 vars in 1245 bytes} [Thu May 13 16:31:26 2021] GET /compute/v2.1/os-volumes/178e485f-6f5e-4c06-a480-3b72766c6037 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:31:27.298342 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:27.299099 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:27.308136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:27.308527 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:27.309335 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:27.309772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:27.366023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lazy-loading 'flavor' on Instance uuid 11a09102-67c9-404f-90f8-05bbee49d1d5 {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:31:27.814263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:27.815380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:27.823133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:27.823927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:27.824850 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:27.825430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:28.024023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-02f35d12-ff18-4a88-9131-55d2d28d3060 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 202 len: 0 microversion: 2.20 time: 0.729203 May 13 16:31:28.025325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 544/1183] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:31:27 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 16:31:28.034046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:28.034770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:28.042844 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:28.045020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:28.045020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:28.045020 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:28.167467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c11d9e84-559d-434f-a6f2-10aa340dee54 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.357801 May 13 16:31:28.171149 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 640/1184] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:31:27 2021] POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:31:28.176549 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:28.177271 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:28.185198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:28.185645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:28.186507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:28.186918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:28.252200 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:28.261894 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:28.263429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:28.264578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3a9b1d2c-f6d1-4fc8-aebe-a9dfce4a6d42 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.235581 May 13 16:31:28.265692 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 545/1185] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:28 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:31:28.398268 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:28.409860 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8b8b943a-efe5-40e0-a960-fb321ef8a0bb tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1749 microversion: 2.1 time: 0.237425 May 13 16:31:28.413128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 641/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:28 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1749 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:29.283054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:29.283679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:29.292090 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:29.292633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:29.293561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:29.294073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:29.427680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:29.428616 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:29.437042 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:29.437611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:29.438469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:29.439358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:29.496746 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:29.523066 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:29.524877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:29.538608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6fd9740d-4f4f-49fe-acc9-108ac30b8c2a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.259163 May 13 16:31:29.539360 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 546/1187] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:29 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:29.660858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:29.669545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-01557bf0-f407-487d-9eb5-138be4da0b09 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1749 microversion: 2.1 time: 0.245574 May 13 16:31:29.670280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 642/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:29 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1749 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:30.556891 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:30.557534 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:30.566458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:30.566458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:30.566732 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:30.566963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:30.686944 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:30.687583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:30.694968 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:30.695674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:30.696506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:30.696956 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:30.771628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:30.792229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:30.803731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:30.803731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-23d3362a-64eb-411d-8530-3fbde73503af tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.241947 May 13 16:31:30.803731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 547/1189] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:30 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:30.909757 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:30.918839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-ea3009ba-c3e7-48b5-a0bb-72bdffe0f724 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.235890 May 13 16:31:30.919410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 643/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:30 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:31.813197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:31.813839 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:31.821234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:31.821636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:31.822418 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:31.822865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:31.937785 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:31.938400 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:31.947142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:31.947670 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:31.948382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:31.948820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:32.029364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:32.039511 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:32.041469 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:32.042615 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1e6b7a7b-dfd6-423b-8e44-7d951971e594 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.233236 May 13 16:31:32.043390 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 548/1191] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:31 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:32.157607 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:32.167447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-22291878-50df-4da7-8f05-9ad71613d869 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.233455 May 13 16:31:32.168032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 644/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:31 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:33.060076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:33.060700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:33.068703 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:33.069197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:33.069981 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:33.070422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:33.183577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:33.184200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:33.191480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:33.191933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:33.192729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:33.193353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:33.265969 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:33.274834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:33.276339 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:33.277495 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dd1a2e1d-362b-4615-8a31-f41e0f9a8c53 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.221192 May 13 16:31:33.278115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 549/1193] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:33 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:33.392871 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:33.401636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d711e24e-c84f-487e-b93b-e0409ec3ef35 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.221762 May 13 16:31:33.402252 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 645/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:33 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:34.295865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:34.301266 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:34.304404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:34.304856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:34.305742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:34.306113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:34.419568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:34.420185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:34.430367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:34.430831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:34.431625 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:34.432072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:34.518432 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:34.527949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:34.529765 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:34.531123 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-044ca4ba-8b3a-4e86-96e0-9d681100c49f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.239235 May 13 16:31:34.531680 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 550/1195] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:34 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:31:34.650152 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:34.659099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5b879f50-1319-4d69-843e-9aac2a6b12e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.243459 May 13 16:31:34.660342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 646/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:34 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:35.549388 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:35.550608 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:35.558421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:35.558881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:35.559681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:35.560125 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:35.677184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:35.677909 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:35.685382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:35.685862 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:35.686656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:35.687091 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:35.763160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:35.772735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:35.774410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:35.775544 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d540f150-44ea-4181-9759-59d0a85176e7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.229974 May 13 16:31:35.776107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 551/1197] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:35 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:35.889541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:35.899022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1aa3e293-d6f0-49dd-a159-8f1417eb6d83 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.226094 May 13 16:31:35.899613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 647/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:35 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:36.794640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:36.795255 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:36.803052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:36.803508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:36.804287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:36.804728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:36.916353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:36.916952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:36.924111 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:36.924566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:36.926120 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:36.926551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:36.999113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:37.008034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:37.009599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:37.010801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-af242acd-a6ee-489e-941a-7d2edb800efc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.220019 May 13 16:31:37.011365 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 552/1199] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:36 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:31:37.125867 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:37.135824 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2de93286-ae60-4528-b1a2-80e7cec28977 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.223427 May 13 16:31:37.136384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 648/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:36 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:31:38.028882 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:38.029528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:38.037559 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:38.038012 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:38.038796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:38.039235 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:38.152769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:38.153438 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:38.161460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:38.161999 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:38.162885 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:38.163338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:38.240316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:38.249919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:38.251494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:38.252661 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-349cb0ce-7bbe-486a-9c9d-4f5536624dc0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.227548 May 13 16:31:38.253314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 553/1201] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:38 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:38.366171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:38.375027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cd50da56-ad09-43e9-8028-9052f0fae037 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.226110 May 13 16:31:38.375686 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 649/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:38 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:39.270834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:39.271429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:39.278707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:39.279165 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:39.279946 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:39.280382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:39.392780 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:39.393577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:39.401004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:39.401513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:39.402323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:39.402758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:39.474981 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:39.483685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:39.485223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:39.486348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-31d4c9ec-d247-4532-9df9-d242d14d9a3f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.219299 May 13 16:31:39.486902 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 554/1203] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:39 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:39.602841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:39.611377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dfc2fe0e-5cb0-4cbf-9e3f-fef2a5067026 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.222373 May 13 16:31:39.611942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 650/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:39 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:40.505172 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:40.505805 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:40.513461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:40.513940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:40.514767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:40.515208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:40.627737 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:40.628410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:40.635936 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:40.636397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:40.637234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:40.637682 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:40.718258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:40.728250 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:40.729835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:40.731095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-94dbe338-ae90-49e5-aafb-f7dfcb767916 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.230344 May 13 16:31:40.734046 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 555/1205] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:40 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:40.844486 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:40.854243 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9490542c-bfb0-485e-8ae3-4e897e90b3d5 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.230301 May 13 16:31:40.864866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 651/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:40 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:41.749298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:41.749911 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:41.757226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:41.757679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:41.758446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:41.758890 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:41.872176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:41.872885 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:41.880624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:41.881195 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:41.881978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:41.882417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:41.959757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:41.968619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:41.970146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:41.972232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4f15a1dd-cbf1-4bc0-ae8d-9ae4d5bd3135 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.225842 May 13 16:31:41.972792 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 556/1207] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:41 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:42.088568 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:42.098032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3d3e53c1-53c8-439b-80e2-f49fb80f9e85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.229577 May 13 16:31:42.102350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 652/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:41 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:42.991273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:42.991893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:42.999605 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:43.000056 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:43.000938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:43.001406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:43.116260 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:43.116821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:43.125363 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:43.125819 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:43.126610 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:43.127050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:43.219073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:43.229618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:43.231295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:43.232643 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bff4ff6b-327b-47af-a5a8-449491b1c282 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.245703 May 13 16:31:43.233236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 557/1209] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:42 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:43.352817 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:43.361932 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-168cbc55-47c2-40d4-a0d0-625c2a6bd062 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.250544 May 13 16:31:43.362581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 653/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:43 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:44.250506 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:44.251173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:44.260279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:44.260733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:44.261544 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:44.262136 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:44.380209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:44.380868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:44.388681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:44.388987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:44.389837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:44.390279 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:44.482453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:44.493367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:44.494937 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:44.496124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f17f3e8f-a71e-486a-9c48-dcf750da68bd tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1743 microversion: 2.20 time: 0.249424 May 13 16:31:44.497186 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 558/1211] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:44 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:44.614401 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:44.623329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1cf99ce6-ce8b-440e-a860-788a3bfbeb02 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.246963 May 13 16:31:44.624395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 654/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:44 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:45.514462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:45.515823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:45.525439 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:45.525896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:45.526687 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:45.527124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:45.641458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:45.642379 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:45.650551 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:45.651268 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:45.652303 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:45.652752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:45.755241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:45.764733 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:45.766298 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:45.767456 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8fd4800b-f8ee-497b-b878-4e7e0759074f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1743 microversion: 2.20 time: 0.256703 May 13 16:31:45.768014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 559/1213] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:45 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:45.891072 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:45.901429 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dad67e91-dd49-483b-b70a-11ed12be3481 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1754 microversion: 2.1 time: 0.264124 May 13 16:31:45.902447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 655/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:45 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:46.785143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:46.786949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:46.794920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:46.795628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:46.796613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:46.797235 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:46.920844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:46.922233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:46.930669 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:46.931441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:46.932480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:46.933104 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:47.198923 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:47.208653 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:47.227927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:47.229052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-2efef18a-3b42-4a36-b4fb-e3431393e6e4 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1757 microversion: 2.1 time: 0.310389 May 13 16:31:47.230430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 656/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:31:46 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1757 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:31:47.232121 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:47.233602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5ac948de-d4e8-418c-9154-2eb30fd3c1f8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.452435 May 13 16:31:47.245580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 560/1216] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:46 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:48.253484 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:48.254417 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:48.262259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:48.262853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:48.264020 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:48.264626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:48.531642 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:48.546384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:48.548763 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:48.557302 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9f18959b-a102-4d1a-85db-d8b75c4f386c tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.304345 May 13 16:31:48.558329 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 657/1217] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:48 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:48.753820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-845f497c-840c-46fe-8608-d753003c780b req-0920f880-55d4-4136-adf3-f5b10623ed4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "name": "network-vif-plugged", "status": "completed", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:31:48.757635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:31:48.757635 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:31:48.770949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-845f497c-840c-46fe-8608-d753003c780b req-0920f880-55d4-4136-adf3-f5b10623ed4e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:48.771398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-845f497c-840c-46fe-8608-d753003c780b req-0920f880-55d4-4136-adf3-f5b10623ed4e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:48.790620 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-845f497c-840c-46fe-8608-d753003c780b req-0920f880-55d4-4136-adf3-f5b10623ed4e service nova] Creating event network-vif-plugged:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:31:48.795871 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-845f497c-840c-46fe-8608-d753003c780b req-0920f880-55d4-4136-adf3-f5b10623ed4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046562 May 13 16:31:48.797134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 561/1218] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:31:49.578520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:49.579146 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:49.586912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:49.597364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:49.597364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:49.597364 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:49.817492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:49.834456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:49.834456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:49.834456 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-aa4c74a5-7cf8-49f0-b8d1-dd1b4a8e4118 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.255198 May 13 16:31:49.835645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 658/1219] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:49 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:50.851101 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:50.852049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:50.861183 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:50.862407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:50.863455 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:50.863979 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:51.148977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:51.162752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:51.166777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:51.168140 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-29c9e4e7-32ac-4adc-8d84-581934e087f2 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.321361 May 13 16:31:51.180048 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 562/1220] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:50 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:52.191724 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:52.193441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:52.202410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:52.202876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:52.203898 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:52.204377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:52.447206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:52.462350 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:52.464035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:52.465332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-302d0085-f9c7-4433-be52-f29af29e5a00 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.279888 May 13 16:31:52.465933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 659/1221] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:52 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:53.489191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:53.491565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:53.501015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:53.501602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:53.502918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:53.503360 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:53.750423 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:53.759885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:53.762509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:53.765855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a1c28e34-d7c5-4d5c-b9e4-d0c14db9af5a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.283813 May 13 16:31:53.766631 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 563/1222] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:53 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:31:54.784609 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:54.786513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:54.795747 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:54.796444 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:54.797601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:54.798075 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:55.021023 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:55.031834 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:55.033629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:55.034980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d7616f8f-1085-4557-ac86-ab1a20fd4661 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.254871 May 13 16:31:55.035896 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 660/1223] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:54 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:56.053509 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:56.054157 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:56.061735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:56.062184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:56.062959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:56.063399 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:56.276636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:56.286735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:56.288232 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:56.289476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7ae07ac3-917e-45d9-a88c-824944453e06 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.240254 May 13 16:31:56.290380 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 564/1224] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:56 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:57.308323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:57.309125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:57.317380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:57.317838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:57.318641 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:57.319087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:57.540216 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:57.550002 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:57.551798 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:57.552946 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7de2a743-7727-4e1f-8d79-d727780a5d5e tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1738 microversion: 2.20 time: 0.248812 May 13 16:31:57.553877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 661/1225] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:57 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:58.571654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:58.572309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:58.580056 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:58.580675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:58.581773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:58.582225 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:58.929581 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:58.938813 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:58.940341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:31:58.941536 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-04d7d09e-67ad-46cb-a8bd-91d78a708685 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1720 microversion: 2.20 time: 0.373670 May 13 16:31:58.942107 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 565/1226] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:58 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:31:59.960232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:31:59.960876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:31:59.968591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:59.969050 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:31:59.969876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:31:59.970327 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:00.169819 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:00.179353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:00.180872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:00.182037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9dfcf870-d015-4cbe-8f51-594140b38335 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1720 microversion: 2.20 time: 0.226176 May 13 16:32:00.182599 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 662/1227] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:31:59 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:01.211579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:01.212209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:01.220565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:01.221295 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:01.222081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:01.222516 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:01.579995 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:01.587997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:01.589522 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:01.590659 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d0d6b615-a7dc-4ebd-b3ff-24f8c6126ee4 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1720 microversion: 2.20 time: 0.382994 May 13 16:32:01.591207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 566/1228] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:01 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:02.610194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:02.610802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:02.618117 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:02.618575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:02.619634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:02.619821 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:02.700960 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-a0215cf1-8f84-40d5-8ac4-d7e3161fa44c req-82735c69-2dd5-46b8-b2ec-78c588ad37f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "name": "network-vif-unplugged", "status": "completed", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:02.702675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:02.702675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:32:02.713622 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-a0215cf1-8f84-40d5-8ac4-d7e3161fa44c req-82735c69-2dd5-46b8-b2ec-78c588ad37f6 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:02.714075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-a0215cf1-8f84-40d5-8ac4-d7e3161fa44c req-82735c69-2dd5-46b8-b2ec-78c588ad37f6 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:02.732089 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-a0215cf1-8f84-40d5-8ac4-d7e3161fa44c req-82735c69-2dd5-46b8-b2ec-78c588ad37f6 service nova] Creating event network-vif-unplugged:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:32:02.737278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-a0215cf1-8f84-40d5-8ac4-d7e3161fa44c req-82735c69-2dd5-46b8-b2ec-78c588ad37f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040090 May 13 16:32:02.737867 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 567/1229] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:32:02.828864 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:02.838709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:02.840331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:02.841526 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-1617a2ff-2596-495b-ae2c-309aa2e39bcf tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1723 microversion: 2.20 time: 0.235145 May 13 16:32:02.842100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 663/1230] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:02 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:02.860578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "557268f4-0b61-40c8-ab6c-30693501a6b2"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:02.861826 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:02.870589 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:02.871050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:02.871860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:02.872304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:03.981458 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4ed640f2-e111-43cd-9355-75de404e77ed tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.125321 May 13 16:32:03.982171 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 568/1231] 10.222.0.42 () {62 vars in 1364 bytes} [Thu May 13 16:32:02 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-volume_attachments => generated 188 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 16:32:04.086940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:04.087492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:04.094990 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:04.095449 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:04.097077 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:04.097580 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:04.838128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d474191b-352e-41a7-94b5-c8e9c5d9f5f7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-volume_attachments/557268f4-0b61-40c8-ab6c-30693501a6b2" status: 202 len: 0 microversion: 2.20 time: 0.754688 May 13 16:32:04.838666 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 664/1232] 10.222.0.42 () {60 vars in 1457 bytes} [Thu May 13 16:32:04 2021] DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/os-volume_attachments/557268f4-0b61-40c8-ab6c-30693501a6b2 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 16:32:04.935732 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:04.936306 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:04.945015 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:04.945548 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:04.946372 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:04.946816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:05.203127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9a6369ba-6e0b-4b3a-9750-f128d6c9c7a0 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action" status: 202 len: 0 microversion: 2.20 time: 0.271196 May 13 16:32:05.203767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 569/1233] 10.222.0.42 () {62 vars in 1319 bytes} [Thu May 13 16:32:04 2021] POST /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 16:32:05.211709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:05.212322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:05.221911 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:05.222369 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:05.223166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:05.223602 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:05.439820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:05.440509 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:05.441874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:05.442998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-23e7751c-5d57-456d-9245-de9b929896cc tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1671 microversion: 2.20 time: 0.235079 May 13 16:32:05.443557 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 665/1234] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:05 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:06.462349 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:06.462996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:06.476179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:06.476179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:06.476179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:06.476179 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:06.682868 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:06.692491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:06.694398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:06.695609 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-beb9a27d-f0cf-45aa-be02-42bf27b17a90 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1671 microversion: 2.20 time: 0.237590 May 13 16:32:06.696171 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 570/1235] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:06 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:07.714151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:07.714998 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:07.723102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:07.723567 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:07.724373 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:07.724808 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:07.922708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:07.932162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:07.933820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:07.935035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-23d195dc-c1b4-4036-b0d5-89754a9f4665 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.224824 May 13 16:32:07.935690 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 666/1236] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:07 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:08.953134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:08.953763 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:08.965011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:08.965429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:08.966206 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:08.968997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:09.217781 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:09.229719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:09.231313 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:09.233666 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-42ab9b6c-5d28-43d2-879f-44004ecda1c1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.283556 May 13 16:32:09.248346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 571/1237] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:08 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:10.255414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:10.256166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:10.263893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:10.264340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:10.265130 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:10.265566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:10.614504 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:10.623206 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:10.624753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:10.625974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7d4cf6a2-a6d0-4f6c-a650-58e05f52f183 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.374478 May 13 16:32:10.626543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 667/1238] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:10 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:11.644562 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:11.645226 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:11.652841 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:11.653117 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:11.653936 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:11.654367 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:11.876656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:11.885828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:11.887323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:11.888445 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-3e425d22-10f9-4d20-888e-8a3c5ec30272 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.247877 May 13 16:32:11.889269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 572/1239] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:11 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:12.907026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:12.907576 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:12.916096 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:12.916552 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:12.917367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:12.917812 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:13.145683 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:13.154733 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:13.156396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:13.157820 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5846a89e-afb6-4b26-b173-94724717c02f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.254457 May 13 16:32:13.158512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 668/1240] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:12 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:14.199142 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:14.199786 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:14.206974 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:14.207440 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:14.208209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:14.208641 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:14.417537 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:14.427073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:14.428588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:14.429827 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2262ecc5-70bc-4d52-b6ae-ce5510abe456 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.234547 May 13 16:32:14.432529 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 573/1241] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:14 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:15.448145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:15.448809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:15.455910 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:15.456476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:15.457280 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:15.457716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:15.694940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:15.704113 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:15.705594 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:15.707291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c1af3071-bdaa-4f21-b452-2587bb70a08a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.263138 May 13 16:32:15.707843 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 669/1242] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:15 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:16.728870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:16.730405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:16.738820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:16.739345 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:16.740134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:16.740569 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:16.947337 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:16.959007 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:16.961100 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:16.962604 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-017d98e9-c7a2-4822-a2a6-ca337ba6f60f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.239603 May 13 16:32:16.963395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 574/1243] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:16 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:17.991446 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:17.992058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:17.999270 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:17.999720 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:18.000506 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:18.000942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:18.271680 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:18.298640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:18.301304 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:18.306241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-52268d66-de82-48b6-bbb9-c6690023afb7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.319077 May 13 16:32:18.313298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 670/1244] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:17 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:19.326192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:19.327280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:19.339182 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:19.349795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:19.349795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:19.349795 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:19.545761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:19.556971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:19.558624 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:19.559828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2e9f1524-d598-449b-9f9d-b01ad64aaab1 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.238809 May 13 16:32:19.560552 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 575/1245] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:19 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:20.578993 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:20.579599 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:20.586936 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:20.587393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:20.588169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:20.588603 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:20.792185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:20.800852 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:20.802399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:20.803527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a3d27f9f-ae19-462c-a8b4-8c825fbfe392 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.228270 May 13 16:32:20.804070 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 671/1246] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:20 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:21.822073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:21.822697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:21.830191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:21.830642 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:21.831554 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:21.831991 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:22.039279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:22.048704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:22.052528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:22.052528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c74ffcff-c5cf-47ce-8f18-280e08c33b37 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.234402 May 13 16:32:22.053188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 576/1247] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:21 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:23.071151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:23.071793 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:23.079051 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:23.079511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:23.080321 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:23.080718 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:23.374447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:23.383209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:23.384765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:23.385935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-42d28753-9dba-43bc-9c45-6a11883d8127 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.318586 May 13 16:32:23.386500 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 672/1248] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:23 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:24.403907 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:24.404518 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:24.415889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:24.415889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:24.415889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:24.415889 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:24.614333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:24.623032 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:24.624528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:24.625681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8dd8ed8f-63c6-4339-94d1-55fbbb576e69 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.225748 May 13 16:32:24.626236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 577/1249] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:24 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:25.645639 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:25.646198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:25.653683 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:25.654142 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:25.654933 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:25.655380 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:25.858913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:25.868578 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:25.870155 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:25.871318 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-73661775-41fb-4cb4-92ec-fac8e8f0db50 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.230270 May 13 16:32:25.872069 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 673/1250] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:25 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:26.886135 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-4cbd8c1a-c8d2-406f-ac47-2af515511e9d req-9aade581-2a37-411e-8d3f-2ec88f10d60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "name": "network-vif-plugged", "status": "completed", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:26.887731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:26.887731 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:32:26.889704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:26.890352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:26.895958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4cbd8c1a-c8d2-406f-ac47-2af515511e9d req-9aade581-2a37-411e-8d3f-2ec88f10d60d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:26.899897 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4cbd8c1a-c8d2-406f-ac47-2af515511e9d req-9aade581-2a37-411e-8d3f-2ec88f10d60d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:26.900009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:26.900009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:26.900009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:26.900009 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:26.912312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-4cbd8c1a-c8d2-406f-ac47-2af515511e9d req-9aade581-2a37-411e-8d3f-2ec88f10d60d service nova] Creating event network-vif-plugged:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:32:26.917949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-4cbd8c1a-c8d2-406f-ac47-2af515511e9d req-9aade581-2a37-411e-8d3f-2ec88f10d60d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 May 13 16:32:26.918888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 578/1251] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:32:27.105048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:27.113730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:27.116027 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:27.117207 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d90fc194-a69d-44dc-8f1b-7066409ddaee tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.231720 May 13 16:32:27.117774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 674/1252] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:26 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:28.136967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:28.137709 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:28.145133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:28.145596 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:28.146394 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:28.146872 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:28.344350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:28.353528 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:28.355028 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:28.356143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c78a2ee7-a129-4139-acc9-ea450157c7a5 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.223565 May 13 16:32:28.356700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 579/1253] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:28 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:32:29.375081 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:29.375600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:29.382953 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:29.383407 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:29.384184 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:29.384624 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:29.594342 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:29.599145 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:29.600687 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:29.602571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5f089b23-88cf-4e9d-957d-a167a29367d7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1729 microversion: 2.20 time: 0.231344 May 13 16:32:29.603125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 675/1254] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:29 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:30.619673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:30.620286 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:30.627602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:30.628081 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:30.628847 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:30.629326 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:30.733497 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-883375607"}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:30.734087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:30.741276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:30.742263 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:30.743037 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:30.743474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:30.828751 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:30.837378 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:30.838877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:30.840007 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-463525ff-ffc4-4956-ab3e-43644ced995f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1716 microversion: 2.20 time: 0.224158 May 13 16:32:30.840584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 580/1255] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:32:30 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1716 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:32:30.938670 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.network.security_group_api [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Removing security group ac237905-6740-4368-9915-e1ef0c7ab3e3 from port 7594a304-140b-4d45-a276-e04edf2da602 May 13 16:32:31.472086 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-96a2a418-bb6a-4863-807a-7cb448d6536d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.742237 May 13 16:32:31.473014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 676/1256] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:32:30 2021] POST /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 16:32:31.484404 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-58db8a31-ccc1-4a6a-b793-d97d31bfe26f req-688c3925-1fa3-4b21-9536-27029064b489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:31.485916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:31.485916 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:32:31.502855 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-58db8a31-ccc1-4a6a-b793-d97d31bfe26f req-688c3925-1fa3-4b21-9536-27029064b489 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:31.503300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-58db8a31-ccc1-4a6a-b793-d97d31bfe26f req-688c3925-1fa3-4b21-9536-27029064b489 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:31.529275 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-58db8a31-ccc1-4a6a-b793-d97d31bfe26f req-688c3925-1fa3-4b21-9536-27029064b489 service nova] Creating event network-changed:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:32:31.540540 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-58db8a31-ccc1-4a6a-b793-d97d31bfe26f req-688c3925-1fa3-4b21-9536-27029064b489 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059644 May 13 16:32:31.541438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 581/1257] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:32:33.709281 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:33.709844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:33.712431 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-d7b3d782-600c-46fe-9513-d54ee64f89d6 req-5489df6d-cd0a-406d-a3e4-83a5c0c553e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:33.713940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:33.713940 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:32:33.717972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:33.720701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:33.720701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:33.720701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:33.723197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d7b3d782-600c-46fe-9513-d54ee64f89d6 req-5489df6d-cd0a-406d-a3e4-83a5c0c553e0 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:33.723654 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-d7b3d782-600c-46fe-9513-d54ee64f89d6 req-5489df6d-cd0a-406d-a3e4-83a5c0c553e0 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:33.742817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-d7b3d782-600c-46fe-9513-d54ee64f89d6 req-5489df6d-cd0a-406d-a3e4-83a5c0c553e0 service nova] Creating event network-changed:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:32:33.747747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-d7b3d782-600c-46fe-9513-d54ee64f89d6 req-5489df6d-cd0a-406d-a3e4-83a5c0c553e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040016 May 13 16:32:33.748879 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 582/1258] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:32:33.887225 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lazy-loading 'services' on Instance uuid a691c66d-523f-4197-949a-60f245007ff8 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:32:34.177475 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0fec01ba-8125-4faf-9b33-291a6f6e1b1d tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments/3331fa76-038b-4f55-9993-b8de12f8736a" status: 202 len: 0 microversion: 2.1 time: 0.472118 May 13 16:32:34.181961 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 677/1259] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:32:33 2021] DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments/3331fa76-038b-4f55-9993-b8de12f8736a => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:32:34.189414 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:34.190768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:34.199429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:34.199892 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:34.200750 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:34.201299 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:34.267919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7b419fa0-ad61-445e-9512-336091e6d882 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083663 May 13 16:32:34.268821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 583/1260] 10.222.0.42 () {58 vars in 1302 bytes} [Thu May 13 16:32:34 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:32:35.279287 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:35.280344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:35.287829 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:35.288293 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:35.289062 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:35.289522 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:35.351630 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6dd18433-dbd2-4129-b797-4937bbe05f85 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076466 May 13 16:32:35.352100 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 678/1261] 10.222.0.42 () {58 vars in 1302 bytes} [Thu May 13 16:32:35 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:32:36.363270 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:36.364174 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:36.371432 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:36.371881 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:36.372644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:36.373094 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:36.435757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-7f0640c0-2824-4402-9892-90c3f98e8a34 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076312 May 13 16:32:36.436312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 584/1262] 10.222.0.42 () {58 vars in 1302 bytes} [Thu May 13 16:32:36 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 16:32:36.446345 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:36.446853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:36.454450 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:36.454912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:36.455696 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:36.456141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:36.610172 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] HTTP exception thrown: Instance a691c66d-523f-4197-949a-60f245007ff8 is not attached to volume 3331fa76-038b-4f55-9993-b8de12f8736a May 13 16:32:36.610805 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Returning 404 to user: Instance a691c66d-523f-4197-949a-60f245007ff8 is not attached to volume 3331fa76-038b-4f55-9993-b8de12f8736a {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:32:36.611636 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b2130227-4ae6-47ca-bc1d-3d7aa26412bf tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments/3331fa76-038b-4f55-9993-b8de12f8736a" status: 404 len: 154 microversion: 2.1 time: 0.169705 May 13 16:32:36.612185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 679/1263] 10.222.0.42 () {58 vars in 1416 bytes} [Thu May 13 16:32:36 2021] DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8/os-volume_attachments/3331fa76-038b-4f55-9993-b8de12f8736a => generated 154 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:32:37.954747 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:37.955369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:37.963303 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:37.963769 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:37.964563 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:37.965010 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:38.024084 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:32:38.337588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-1a0c0340-be57-43ee-a873-bfa502688757 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 204 len: 0 microversion: 2.1 time: 0.386223 May 13 16:32:38.338167 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 585/1264] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:32:37 2021] DELETE /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:32:38.346753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:38.347251 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:38.354492 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:38.354942 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:38.355722 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:38.356160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:38.620916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:38.629112 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e845c961-1e14-4a35-88a3-f5ce29960784 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1553 microversion: 2.1 time: 0.286668 May 13 16:32:38.629672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 680/1265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:38 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:39.647510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:39.648834 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:39.656011 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:39.656460 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:39.657319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:39.657756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:39.923865 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:39.932588 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ab3293e1-ec27-441e-8bdc-9457446a36da tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1553 microversion: 2.1 time: 0.289313 May 13 16:32:39.933178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 586/1266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:39 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:40.949999 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:40.950691 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:40.958178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:40.958895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:40.959760 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:40.960292 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:41.157634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:41.166688 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-20123a80-9528-4e55-a1a6-4a7229713a39 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1553 microversion: 2.1 time: 0.221571 May 13 16:32:41.167257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 681/1267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:40 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:41.519704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-efa83abf-7173-422e-824e-40209bdee15e req-67a7f746-d01e-4126-abf6-d1bdad3d7002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a691c66d-523f-4197-949a-60f245007ff8", "name": "network-vif-deleted", "tag": "7594a304-140b-4d45-a276-e04edf2da602"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:41.521273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:41.521273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:32:41.530108 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-efa83abf-7173-422e-824e-40209bdee15e req-67a7f746-d01e-4126-abf6-d1bdad3d7002 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:41.530551 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-efa83abf-7173-422e-824e-40209bdee15e req-67a7f746-d01e-4126-abf6-d1bdad3d7002 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:41.547103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-efa83abf-7173-422e-824e-40209bdee15e req-67a7f746-d01e-4126-abf6-d1bdad3d7002 service nova] Creating event network-vif-deleted:7594a304-140b-4d45-a276-e04edf2da602 for instance a691c66d-523f-4197-949a-60f245007ff8 on hv-cinder-68948 May 13 16:32:41.551646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-efa83abf-7173-422e-824e-40209bdee15e req-67a7f746-d01e-4126-abf6-d1bdad3d7002 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035781 May 13 16:32:41.552236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 587/1268] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:32:42.183943 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:42.184513 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:42.192061 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:42.192520 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:42.193332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:42.193773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:42.305861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:42.313919 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-24a33225-53a5-4469-ae5e-5392690904d7 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1343 microversion: 2.1 time: 0.133759 May 13 16:32:42.314469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 682/1269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:42 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1343 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:43.161583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:43.162165 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:43.169695 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.170150 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.170919 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.171355 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.229842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:32:43.330980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:43.331608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:43.339338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.339789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.340571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.340996 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.450299 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:43.458875 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e2dab5d1-21cf-4ef1-ac26-7ba950c517f0 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1343 microversion: 2.1 time: 0.131534 May 13 16:32:43.465220 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 683/1270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:43 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1343 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:32:43.549597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b3a9f12b-3f33-4822-be4b-24532e1e07a7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 204 len: 0 microversion: 2.1 time: 0.391975 May 13 16:32:43.550195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 588/1271] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:32:43 2021] DELETE /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:32:43.558672 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:43.559286 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:43.566816 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.567272 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.568096 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:43.568537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:43.764150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:43.772549 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-04e1129a-f461-4dd4-b486-47d3003011c7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1579 microversion: 2.1 time: 0.218102 May 13 16:32:43.773642 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 684/1272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:43 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1579 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:44.476782 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:44.477517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:44.484877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:44.485357 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:44.486143 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:44.486586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:44.689605 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d7a514496e4e73845771d76702cbe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8903bce27d65496bb95a7263f3f00c38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:44.698217 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-173eaf14-0d8f-477f-9cc1-760df9403917 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 200 len: 1343 microversion: 2.1 time: 0.225610 May 13 16:32:44.698787 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 589/1273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:44 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 1343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:44.791433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:44.792087 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:44.799478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:44.799920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:44.800707 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:44.801175 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:44.993734 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:45.001858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c85dde75-6f36-4180-915a-8bb32fbbd32c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1579 microversion: 2.1 time: 0.214935 May 13 16:32:45.002424 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 685/1274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:44 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:45.715586 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:45.716204 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] [instance: a691c66d-523f-4197-949a-60f245007ff8] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:45.723788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:45.724241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:45.725021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:45.725489 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:45.775004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] HTTP exception thrown: Instance a691c66d-523f-4197-949a-60f245007ff8 could not be found. May 13 16:32:45.775611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Returning 404 to user: Instance a691c66d-523f-4197-949a-60f245007ff8 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:32:45.776453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-684aeb88-e552-42ac-9cbd-f7ef611dba91 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8" status: 404 len: 111 microversion: 2.1 time: 0.064705 May 13 16:32:45.777003 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 590/1275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:45 2021] GET /compute/v2.1/servers/a691c66d-523f-4197-949a-60f245007ff8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:32:45.785222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-98a24986-f9e6-4888-b3e2-2b11f4907706 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] Calling method '.version_select at 0x7ffa8e727b80>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:45.873193 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-98a24986-f9e6-4888-b3e2-2b11f4907706 tempest-TestMinimumBasicScenario-1740307618 tempest-TestMinimumBasicScenario-1740307618-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388809040" status: 202 len: 0 microversion: 2.1 time: 0.091529 May 13 16:32:45.873839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 686/1276] 10.222.0.42 () {58 vars in 1269 bytes} [Thu May 13 16:32:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388809040 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:32:46.018395 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:46.019016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:46.026300 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:46.029017 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:46.029017 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:46.029017 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:46.225410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:46.235311 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-614e2467-cb65-4b4a-aff1-9a6f86c502af tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1579 microversion: 2.1 time: 0.220541 May 13 16:32:46.235873 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 591/1277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:46 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1579 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:47.253174 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:47.253939 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:47.262178 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:47.262629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:47.263437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:47.263872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:47.465564 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:47.474227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5d6a858d-e0c1-4c07-8784-9cea963db86d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1579 microversion: 2.1 time: 0.225118 May 13 16:32:47.482382 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 687/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:47 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1579 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:48.497909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:48.497909 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:48.505194 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:48.505651 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:48.506435 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:48.506870 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:48.817375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:48.826593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d9087e96-82dc-4c72-b912-f7415fdfd339 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1512 microversion: 2.1 time: 0.333372 May 13 16:32:48.827170 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 592/1279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:48 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:49.012317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-be131e72-e65d-4047-b514-9f4db5b678e2 req-0da680c9-d22b-45e4-9a41-ee7098df44cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdf08-2e6a-4702-9d0b-668517b4105b", "name": "network-vif-deleted", "tag": "3b03f95d-0f76-4953-8ef6-f8e0c4d437f3"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:49.014365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:32:49.014365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:32:49.022877 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-be131e72-e65d-4047-b514-9f4db5b678e2 req-0da680c9-d22b-45e4-9a41-ee7098df44cf service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:49.023460 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-be131e72-e65d-4047-b514-9f4db5b678e2 req-0da680c9-d22b-45e4-9a41-ee7098df44cf service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:49.040052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-be131e72-e65d-4047-b514-9f4db5b678e2 req-0da680c9-d22b-45e4-9a41-ee7098df44cf service nova] Creating event network-vif-deleted:3b03f95d-0f76-4953-8ef6-f8e0c4d437f3 for instance 93dcdf08-2e6a-4702-9d0b-668517b4105b on hv-cinder-68948 May 13 16:32:49.045643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-be131e72-e65d-4047-b514-9f4db5b678e2 req-0da680c9-d22b-45e4-9a41-ee7098df44cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037976 May 13 16:32:49.046464 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 688/1280] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:32:49.843796 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:49.845344 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:49.862448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:49.863169 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:49.869842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:49.869842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:49.999557 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:50.000021 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:50.000487 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.objects.instance [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lazy-loading 'fault' on Instance uuid 93dcdf08-2e6a-4702-9d0b-668517b4105b {{(pid=93649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:32:50.246685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:50.264294 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-937008ca-1026-40ba-9c6f-ff1cd1267b13 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 200 len: 1231 microversion: 2.1 time: 0.424203 May 13 16:32:50.265001 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 593/1281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:49 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 1231 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:51.289228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:51.290547 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:51.299654 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:51.300398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:51.301491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:51.302141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:51.366089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] HTTP exception thrown: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. May 13 16:32:51.367535 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Returning 404 to user: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:32:51.368186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-123b8a8d-9e84-4d61-b93d-fd6262415d9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 404 len: 111 microversion: 2.1 time: 0.086197 May 13 16:32:51.368730 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 689/1282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:51 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:32:51.487425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1735187102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1568395761", "security_groups": [{"name": "tempest-secgroup-smoke-634050492"}], "block_device_mapping_v2": [{"uuid": "aaf5ac66-0899-431b-beec-e39e3fd9bd46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fce931a8-623e-4de8-8c85-53a4453b90f8"}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:32:51.769425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] validate_networks() for [('fce931a8-623e-4de8-8c85-53a4453b90f8', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:32:52.871452 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:32:52.872052 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:32:52.872374 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:32:52.872791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:32:52.873246 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:32:52.881619 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:52.882075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:52.883438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:52.883884 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:52.902265 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:32:52.906318 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for user 78405c5c40f74675b76fc3b44b6da73b and project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:32:53.011407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:32:53.013952 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaf5ac66-0899-431b-beec-e39e3fd9bd46',volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:32:53.524745 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-a60d4466-5159-4bd9-b956-42972b5fcf7f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.041059 May 13 16:32:53.525697 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 594/1283] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:32:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:32:53.536144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a46cd2d5-65ea-48a4-9feb-7809b5e034fb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:53.538236 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a46cd2d5-65ea-48a4-9feb-7809b5e034fb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:53.627613 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a46cd2d5-65ea-48a4-9feb-7809b5e034fb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:53.636108 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a46cd2d5-65ea-48a4-9feb-7809b5e034fb tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1095 microversion: 2.1 time: 0.103766 May 13 16:32:53.636920 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 690/1284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:53 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:32:54.653488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:54.655770 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:54.662276 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:54.662749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:54.663614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:54.664057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:54.887773 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:54.896828 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-aff131b9-4dd2-4f53-85fc-a8ec768543c8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1145 microversion: 2.1 time: 0.247049 May 13 16:32:54.897546 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 595/1285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:54 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1145 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:55.914255 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:55.915123 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:55.924378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:55.924838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:55.925860 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:55.926532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:56.044230 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:56.052495 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-adae0b63-87f0-4db7-b799-2c56797ac0f8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1211 microversion: 2.1 time: 0.142097 May 13 16:32:56.053054 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 691/1286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:55 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:32:57.069755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:57.070987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:57.078241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:57.079668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:57.079668 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:57.080058 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:57.228923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:57.237332 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2530e373-603b-41ca-bb9e-7576564b0760 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1211 microversion: 2.1 time: 0.171371 May 13 16:32:57.237949 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 596/1287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:57 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:58.254974 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:58.256102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:58.264029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:58.264480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:58.265323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:58.265772 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:58.478756 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:32:58.486503 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4167e791-47a7-444b-b013-058c6e57025b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.235918 May 13 16:32:58.487331 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 692/1288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:58 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:32:59.503811 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:32:59.505004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:32:59.513988 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:59.519322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:32:59.519322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:32:59.519322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:00.007350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:00.015788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-74a807d0-ba19-4027-a088-643e6007edb8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.515826 May 13 16:33:00.016358 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 597/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:32:59 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:00.217771 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-0cb06035-acba-4966-9d5a-6009cedb9397 req-361c9faa-0e17-4eca-8be2-4214483a942e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f24a0e-ba52-4f95-b700-08d1c0fa342e", "tag": "da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:00.219588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:33:00.219588 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:33:00.228773 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-0cb06035-acba-4966-9d5a-6009cedb9397 req-361c9faa-0e17-4eca-8be2-4214483a942e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:00.229257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-0cb06035-acba-4966-9d5a-6009cedb9397 req-361c9faa-0e17-4eca-8be2-4214483a942e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:00.251937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-0cb06035-acba-4966-9d5a-6009cedb9397 req-361c9faa-0e17-4eca-8be2-4214483a942e service nova] Creating event network-changed:da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65 for instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e on hv-cinder-68948 May 13 16:33:00.258414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-0cb06035-acba-4966-9d5a-6009cedb9397 req-361c9faa-0e17-4eca-8be2-4214483a942e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044532 May 13 16:33:00.259646 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 693/1290] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:33:01.032860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:01.033686 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:01.042338 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:01.043212 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:01.044119 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:01.044931 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:01.537077 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:01.550133 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-44de9279-3a1e-49ee-b6e7-2a765ef7c754 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.521179 May 13 16:33:01.561602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 598/1291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:01 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:02.568397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:02.569155 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:02.577884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:02.578254 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:02.579031 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:02.579472 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:02.783388 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:02.792810 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7c3600f4-3513-4291-bfa2-4d63e9401ba3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.228876 May 13 16:33:02.793410 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 694/1292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:02 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:03.809375 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:03.809970 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:03.817636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:03.818203 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:03.819014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:03.819484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:04.015823 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:04.024599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e1b74f9a-0e75-4eb1-af6b-0689b532e5f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.219091 May 13 16:33:04.032477 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 599/1293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:03 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:05.040927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:05.041618 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:05.048668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:05.049151 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:05.049937 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:05.050376 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:05.250248 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:05.259759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-58981585-9385-4044-80bd-4f07c5d10b87 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.222609 May 13 16:33:05.260315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 695/1294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:05 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:05.684897 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:05.685447 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:05.692971 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:05.693464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:05.694278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:05.695302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:05.755698 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:33:06.100127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bd13b557-e216-4630-a3b8-237c535f2ee7 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 204 len: 0 microversion: 2.20 time: 0.418667 May 13 16:33:06.100716 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 600/1295] 10.222.0.42 () {60 vars in 1280 bytes} [Thu May 13 16:33:05 2021] DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 16:33:06.108555 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:06.109349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:06.117067 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:06.117627 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:06.118398 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:06.118836 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:06.276607 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:06.277340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:06.293977 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:06.294438 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:06.295322 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:06.295801 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:06.342259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:06.354916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:06.356660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:06.358199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-afbf54bf-fe5a-41f3-819c-76fec8bb6999 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.253274 May 13 16:33:06.359149 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 696/1296] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:06 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:33:06.621106 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:06.629341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-24affdb6-a5c0-4e03-8c77-bddaa3241dc2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.357131 May 13 16:33:06.629913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 601/1297] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:06 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:33:07.377250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:07.377841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:07.386415 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:07.386889 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:07.387705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:07.388136 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:07.612815 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:07.623144 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:07.624969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:07.626314 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-14f2e68b-bff0-43c6-8767-a5b36e1359a8 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.253051 May 13 16:33:07.626872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 697/1298] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:07 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:33:07.646051 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:07.646816 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:07.654429 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:07.655270 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:07.656336 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:07.657027 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:08.191913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:08.209417 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-020c207b-1460-4ada-8807-5322158c8e4e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.566989 May 13 16:33:08.210009 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 602/1299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:07 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:08.644848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:08.645532 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:08.656661 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:08.658149 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:08.658972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:08.659540 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:08.919752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:08.929774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:08.931573 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:08.932872 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0d3c2c1c-e873-4c0f-b65e-caa2750baa5f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1722 microversion: 2.20 time: 0.291795 May 13 16:33:08.934146 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 698/1300] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:08 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:33:09.229877 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:09.230499 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:09.238201 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:09.239241 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:09.240710 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:09.241353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:09.657301 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:09.667263 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ac87f14c-10ab-43e0-89a4-585b61b395d6 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.441503 May 13 16:33:09.667868 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 603/1301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:09 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:09.951377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:09.951994 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:09.965052 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:09.965539 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:09.966340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:09.966779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:10.131673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:10.157384 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:10.159866 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:10.162765 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-8a10c426-84df-4579-86af-f637e8d723eb tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1654 microversion: 2.20 time: 0.215148 May 13 16:33:10.163558 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 699/1302] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:09 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1654 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 16:33:10.684029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:10.685282 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:10.692756 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:10.693466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:10.694413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:10.695611 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:11.020979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-8684ee36-f1ee-4d82-8c9d-ccd13f308ba0 req-31c3abca-7407-4f61-aed0-bb760b82cc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a09102-67c9-404f-90f8-05bbee49d1d5", "name": "network-vif-deleted", "tag": "00553084-af86-4a16-98ef-22c6575ec987"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:11.023962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:33:11.023962 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:33:11.033389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-8684ee36-f1ee-4d82-8c9d-ccd13f308ba0 req-31c3abca-7407-4f61-aed0-bb760b82cc99 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:11.035888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-8684ee36-f1ee-4d82-8c9d-ccd13f308ba0 req-31c3abca-7407-4f61-aed0-bb760b82cc99 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:11.055377 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-8684ee36-f1ee-4d82-8c9d-ccd13f308ba0 req-31c3abca-7407-4f61-aed0-bb760b82cc99 service nova] Creating event network-vif-deleted:00553084-af86-4a16-98ef-22c6575ec987 for instance 11a09102-67c9-404f-90f8-05bbee49d1d5 on hv-cinder-68948 May 13 16:33:11.061658 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-8684ee36-f1ee-4d82-8c9d-ccd13f308ba0 req-31c3abca-7407-4f61-aed0-bb760b82cc99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044776 May 13 16:33:11.062957 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 700/1303] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:33:11.187840 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:11.189615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:11.205569 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:11.207115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:11.208716 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:11.209865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:11.356400 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:11.418233 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ace834d8-e2e9-4741-be23-658f619b7a69 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.737413 May 13 16:33:11.434027 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 604/1304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:10 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:11.807453 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:33:11.808376 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:33:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:33:11.936663 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:11.948689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:11.951289 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebd2e046f46941649877e479827383ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3765c8e449420cbc3921f5d16d0b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:11.952628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-733107b7-c62c-41e2-89df-ba2cc8af393f tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 200 len: 1364 microversion: 2.20 time: 0.774559 May 13 16:33:11.953674 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 701/1305] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:11 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 1364 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 16:33:12.444964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:12.446199 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:12.459466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:12.459924 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:12.460755 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:12.461230 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:12.740699 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:12.751618 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-233aeb6a-ae88-4060-8aab-e6f8c925e95a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.310984 May 13 16:33:12.762320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 605/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:12 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:12.971014 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:12.971854 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:12.980133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:12.980731 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:12.981704 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:12.982375 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:13.040433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. May 13 16:33:13.041728 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:33:13.042853 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-73002f42-7b23-4cba-9291-b9c7c0acd568 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 404 len: 111 microversion: 2.20 time: 0.075868 May 13 16:33:13.043626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 702/1307] 10.222.0.42 () {60 vars in 1277 bytes} [Thu May 13 16:33:12 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 16:33:13.051954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4ea58af3-1ef5-4c96-ab89-fce62767a185 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '.version_select at 0x7ffa8c865310>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:13.150791 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4ea58af3-1ef5-4c96-ab89-fce62767a185 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7941398" status: 204 len: 0 microversion: 2.20 time: 0.102446 May 13 16:33:13.152444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 606/1308] 10.222.0.42 () {60 vars in 1253 bytes} [Thu May 13 16:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7941398 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 16:33:13.768581 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:13.769232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:13.777721 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:13.778429 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:13.779389 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:13.780019 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:14.066044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:14.075694 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-619589ca-33e7-4737-915b-25af44011376 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.310623 May 13 16:33:14.076363 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 703/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:13 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:15.092508 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:15.093247 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:15.105224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:15.105993 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:15.108398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:15.108398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:15.452346 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:15.461530 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c5690580-2c9a-4af9-b071-746ae190bcbc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.372820 May 13 16:33:15.462215 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 607/1310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:15 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:16.023160 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:16.028656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:16.032402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.032861 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.033705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.034319 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.149004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. May 13 16:33:16.149004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:33:16.149004 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4a5b14f9-be40-43df-953a-d6c59cc6c821 tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 404 len: 111 microversion: 2.1 time: 0.129804 May 13 16:33:16.149570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 704/1311] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:33:16 2021] DELETE /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:33:16.158553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:16.160208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 11a09102-67c9-404f-90f8-05bbee49d1d5] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:16.170652 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.171368 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.172972 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.173614 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.229625 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. May 13 16:33:16.230271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 11a09102-67c9-404f-90f8-05bbee49d1d5 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:33:16.231118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-22658a1f-38a2-4ec0-a0d9-1145c22d5c1d tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5" status: 404 len: 111 microversion: 2.1 time: 0.077077 May 13 16:33:16.231689 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 608/1312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:16 2021] GET /compute/v2.1/servers/11a09102-67c9-404f-90f8-05bbee49d1d5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:33:16.292729 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-c17064cb-8d94-489c-8dda-62ff780ab7db req-03082e05-339e-48a0-9fd9-a3a574c0b2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f24a0e-ba52-4f95-b700-08d1c0fa342e", "name": "network-vif-plugged", "status": "completed", "tag": "da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:16.295283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:33:16.295283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:33:16.307253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-c17064cb-8d94-489c-8dda-62ff780ab7db req-03082e05-339e-48a0-9fd9-a3a574c0b2fe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.307952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-c17064cb-8d94-489c-8dda-62ff780ab7db req-03082e05-339e-48a0-9fd9-a3a574c0b2fe service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.326771 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-c17064cb-8d94-489c-8dda-62ff780ab7db req-03082e05-339e-48a0-9fd9-a3a574c0b2fe service nova] Creating event network-vif-plugged:da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65 for instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e on hv-cinder-68948 May 13 16:33:16.332053 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-c17064cb-8d94-489c-8dda-62ff780ab7db req-03082e05-339e-48a0-9fd9-a3a574c0b2fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049861 May 13 16:33:16.333138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 705/1313] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:33:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:33:16.479118 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:16.489340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:16.489340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.489340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.489679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:16.489878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:16.773962 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:16.782304 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-67ef5147-4e41-45ec-b8b6-f2e52a74f52e tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.307489 May 13 16:33:16.782925 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 609/1314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:16 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:17.705706 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:17.706293 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:17.714884 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.715340 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.716125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.716559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.778222 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. May 13 16:33:17.779511 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:33:17.781621 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fc619e69-be23-45e3-85b2-9e94f698c10a tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 404 len: 111 microversion: 2.1 time: 0.079799 May 13 16:33:17.784049 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 706/1315] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:33:17 2021] DELETE /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:33:17.793184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:17.794973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] [instance: 2e30d89e-b80d-4ed2-ba2b-38830643d9c7] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:17.800874 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:17.802951 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:17.804111 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.804777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.805846 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.806482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.826701 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.827194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.828034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:17.828485 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:17.877578 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] HTTP exception thrown: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. May 13 16:33:17.878190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] Returning 404 to user: Instance 2e30d89e-b80d-4ed2-ba2b-38830643d9c7 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:33:17.879040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-03c6234a-ca6e-4842-bca3-d8b76df7160b tempest-AttachVolumeShelveTestJSON-984109528 tempest-AttachVolumeShelveTestJSON-984109528-project] 10.222.0.42 "GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7" status: 404 len: 111 microversion: 2.1 time: 0.090024 May 13 16:33:17.885466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 610/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:17 2021] GET /compute/v2.1/servers/2e30d89e-b80d-4ed2-ba2b-38830643d9c7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:33:18.703708 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:18.720898 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-34083c9a-67dd-4fc1-bad9-fcc4f98c9111 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1266 microversion: 2.1 time: 0.925218 May 13 16:33:18.723298 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 707/1317] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:17 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1266 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:19.474963 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:33:19.478474 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:33:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:33:19.740059 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:19.742029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:19.758637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:19.759153 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:19.760042 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:19.760701 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:20.176640 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:20.186851 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-dbf56070-1245-4713-a316-c1029eaf29f2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1454 microversion: 2.1 time: 0.450664 May 13 16:33:20.188271 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 611/1318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:19 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1454 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:20.203930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:20.205177 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:20.214035 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:20.214783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:20.215757 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:20.216367 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:20.911693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:20.923561 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-30731c33-5bee-45e6-b3a7-49ec81bd44d9 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1454 microversion: 2.1 time: 0.723251 May 13 16:33:20.928059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 708/1319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:20 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1454 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:25.891702 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Action: 'create', calling method: .version_select at 0x7ffa8c865dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1179113080"}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:25.918352 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:33:25.922913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for user a73b86e4fe3742109bbeca59c614167b and project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:33:26.416356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:33:26.424665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for user a73b86e4fe3742109bbeca59c614167b and project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'key_pairs'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:33:26.444575 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c438b472-14d1-4c0c-a952-2c0c9f189137 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.773317 May 13 16:33:26.445907 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 612/1320] 10.222.0.42 () {60 vars in 1158 bytes} [Thu May 13 16:33:25 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:26.801879 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-46f2f4a3-d522-4a7a-bf77-91ea55d6b9ba req-d6e9f1af-efa9-4913-be44-8c5ca13a8a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f24a0e-ba52-4f95-b700-08d1c0fa342e", "tag": "da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:26.807477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:33:26.807477 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:33:26.829668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-46f2f4a3-d522-4a7a-bf77-91ea55d6b9ba req-d6e9f1af-efa9-4913-be44-8c5ca13a8a7d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:26.830129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-46f2f4a3-d522-4a7a-bf77-91ea55d6b9ba req-d6e9f1af-efa9-4913-be44-8c5ca13a8a7d service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:26.862754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-46f2f4a3-d522-4a7a-bf77-91ea55d6b9ba req-d6e9f1af-efa9-4913-be44-8c5ca13a8a7d service nova] Creating event network-changed:da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65 for instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e on hv-cinder-68948 May 13 16:33:26.869660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-46f2f4a3-d522-4a7a-bf77-91ea55d6b9ba req-d6e9f1af-efa9-4913-be44-8c5ca13a8a7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072149 May 13 16:33:26.871022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 709/1321] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:33:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:33:54.587726 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1126858728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1179113080", "security_groups": [{"name": "tempest-secgroup-smoke-1933134190"}], "networks": [{"uuid": "ad129812-eaba-4abb-aed5-e94fed1ca2d9"}], "block_device_mapping_v2": [{"uuid": "fb0da1cb-7a48-4330-af72-789d4624bc15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:33:54.820082 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.network.neutron [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] validate_networks() for [('ad129812-eaba-4abb-aed5-e94fed1ca2d9', None, None, None)] {{(pid=93649) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:33:55.637902 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Flavor limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:33:55.638479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Image limits 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:33:55.638927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Flavor pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:33:55.639409 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Image pref 0:0:0 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:33:55.639914 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.virt.hardware [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:33:55.649302 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:55.649673 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:55.650477 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:55.650945 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:55.668092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:33:55.672278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.quota [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Getting quotas for user a73b86e4fe3742109bbeca59c614167b and project 0d5b3dee3fbc494c935bd20a2cda3c32. Resources: {'instances', 'ram', 'cores'} {{(pid=93649) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:33:55.777023 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Going to run 1 instances... {{(pid=93649) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:33:55.779333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb0da1cb-7a48-4330-af72-789d4624bc15',volume_size=None,volume_type=None)] {{(pid=93649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:33:56.299860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bc941904-a7b4-49e0-91bd-c04ef14a0fca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.716652 May 13 16:33:56.300510 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 613/1322] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:33:54 2021] POST /compute/v2.1/servers => generated 406 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:33:56.311632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-50bb5738-86fb-430e-b082-6c4237e52661 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:56.312337 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-50bb5738-86fb-430e-b082-6c4237e52661 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:56.483986 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-50bb5738-86fb-430e-b082-6c4237e52661 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:56.491869 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-50bb5738-86fb-430e-b082-6c4237e52661 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1089 microversion: 2.1 time: 0.184604 May 13 16:33:56.492455 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 710/1323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:56 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1089 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:57.509547 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b6577f8d-0538-4eb1-8203-b62dbe607625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:57.510093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b6577f8d-0538-4eb1-8203-b62dbe607625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:57.582821 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b6577f8d-0538-4eb1-8203-b62dbe607625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:57.590987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b6577f8d-0538-4eb1-8203-b62dbe607625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1089 microversion: 2.1 time: 0.085962 May 13 16:33:57.591555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 614/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:57 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:58.608291 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:58.608964 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:58.617237 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:58.617693 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:58.618478 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:58.618916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:58.731848 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:58.740219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-abb247e6-ac5f-4bc1-b6a8-95126f012cf8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1139 microversion: 2.1 time: 0.135792 May 13 16:33:58.740783 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 711/1325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:58 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1139 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:33:59.757289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:33:59.758016 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:33:59.765931 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:59.766415 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:59.767205 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:33:59.767647 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:33:59.878923 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:33:59.888138 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-603c4249-a991-4c5c-b49b-1930555da45b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1131 microversion: 2.1 time: 0.135214 May 13 16:33:59.888719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 615/1326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:33:59 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1131 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:00.906846 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:00.908306 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:00.916830 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:00.919365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:00.919365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:00.919365 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:01.041684 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:01.050503 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-14f956c7-589a-4ef2-b5b0-5a12bfcf0d29 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1195 microversion: 2.1 time: 0.147593 May 13 16:34:01.051089 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 712/1327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:00 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1195 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:02.067936 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:02.068582 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:02.075727 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:02.076188 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:02.077006 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:02.077475 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:02.679047 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:02.687679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4074c2b2-c85f-47e2-9372-634492c6f0ca tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1273 microversion: 2.1 time: 0.623608 May 13 16:34:02.688251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 616/1328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:02 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1273 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:03.449787 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-507ab61b-2f51-4893-bf6b-d5655d73fa13 req-adda1dbf-d386-44c8-b158-5c3161bcbacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:34:03.450273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:34:03.450273 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:34:03.458490 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-507ab61b-2f51-4893-bf6b-d5655d73fa13 req-adda1dbf-d386-44c8-b158-5c3161bcbacb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:03.459592 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-507ab61b-2f51-4893-bf6b-d5655d73fa13 req-adda1dbf-d386-44c8-b158-5c3161bcbacb service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:03.476653 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-507ab61b-2f51-4893-bf6b-d5655d73fa13 req-adda1dbf-d386-44c8-b158-5c3161bcbacb service nova] Creating event network-changed:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:34:03.481828 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-507ab61b-2f51-4893-bf6b-d5655d73fa13 req-adda1dbf-d386-44c8-b158-5c3161bcbacb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037249 May 13 16:34:03.494983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 713/1329] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:34:03.705178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:03.705706 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:03.713224 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:03.713675 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:03.714456 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:03.714897 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:03.915863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:03.924462 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e29fe261-00cb-4c2c-8a9a-c17aa682f444 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.223049 May 13 16:34:03.925049 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 617/1330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:03 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:04.943483 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:04.944199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:04.951728 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:04.952185 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:04.952960 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:04.953425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:05.150454 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:05.159137 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9d8f1aa4-6b45-4129-a23b-afe24b2d48c0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.220340 May 13 16:34:05.159700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 714/1331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:04 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:06.175959 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:06.176601 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:06.184198 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:06.184655 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:06.185463 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:06.185901 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:06.485822 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:06.495077 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-168fa238-43fd-403c-b166-84f626f05f14 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.322757 May 13 16:34:06.495667 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 618/1332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:06 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:07.512673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:07.513419 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:07.522357 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:07.522814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:07.523617 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:07.524082 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:07.580750 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe3665b-a8b9-47e8-8e37-c134333e66a6] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 13 16:34:07.829893 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:07.838393 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-9e8a5df4-6913-4c5d-ba3f-c19b72bd00fc tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.329488 May 13 16:34:07.838979 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 715/1333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:07 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:08.855646 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:08.856222 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:08.863627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:08.864088 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:08.864902 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:08.865368 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:09.169356 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:09.178040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-32e146e0-df81-420d-b274-ec4bb9538670 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.325641 May 13 16:34:09.181685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 619/1334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:08 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:10.194845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:10.195488 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:10.215010 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:10.215507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:10.216247 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:10.216676 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:10.250056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe3665b-a8b9-47e8-8e37-c134333e66a6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 55478. May 13 16:34:10.415918 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:10.424099 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-13e7b6a2-a849-4855-8f74-cbdd7bf0a9de tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.233491 May 13 16:34:10.424660 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 716/1335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:10 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:11.441628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:11.442249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:11.450075 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:11.450526 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:11.451316 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:11.451761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:11.654192 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:11.662515 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-91dbdd41-f310-4233-84d3-076c16902af7 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.224604 May 13 16:34:11.663092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 620/1336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:11 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:12.679598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:12.680203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:12.688181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:12.688628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:12.689435 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:12.689868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:12.888253 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:12.897352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b5924608-8a8c-4a16-bcf0-b13b2671d9ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.221294 May 13 16:34:12.898187 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 717/1337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:12 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:34:13.915005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:13.915549 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:13.922827 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:13.923411 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:13.924197 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:13.924637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:14.123227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:14.131710 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-19a6a12c-349d-463e-9b55-be2db52bc37c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.221090 May 13 16:34:14.134997 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 621/1338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:13 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:15.148045 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:15.148744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:15.156657 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:15.157141 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:15.157981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:15.158414 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:15.371531 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:15.380011 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-3bc3e4a4-6484-4389-bd51-6e241e05291c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.235808 May 13 16:34:15.380583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 718/1339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:15 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:16.398707 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:16.399331 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:16.406953 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:16.407406 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:16.408204 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:16.408637 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:16.608407 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:16.618627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5dc84dbf-27cb-489c-b9b0-f37a0041acb8 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.224541 May 13 16:34:16.619208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 622/1340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:16 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:17.123837 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-511c4c05-174b-4b79-8c3b-60e6e1a069c6 req-4a4e2f57-9903-41bf-bc31-72a1e0b7e89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "name": "network-vif-plugged", "status": "completed", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:34:17.125383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:34:17.125383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:34:17.133744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-511c4c05-174b-4b79-8c3b-60e6e1a069c6 req-4a4e2f57-9903-41bf-bc31-72a1e0b7e89e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:17.134197 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-511c4c05-174b-4b79-8c3b-60e6e1a069c6 req-4a4e2f57-9903-41bf-bc31-72a1e0b7e89e service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:17.150233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-511c4c05-174b-4b79-8c3b-60e6e1a069c6 req-4a4e2f57-9903-41bf-bc31-72a1e0b7e89e service nova] Creating event network-vif-plugged:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:34:17.155231 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-511c4c05-174b-4b79-8c3b-60e6e1a069c6 req-4a4e2f57-9903-41bf-bc31-72a1e0b7e89e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157810 May 13 16:34:17.156066 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 719/1341] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:34:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:34:17.635364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:17.635973 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:17.643289 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:17.643735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:17.644605 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:17.645040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:17.901220 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:17.909329 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-9653c495-5879-48bf-b50b-91ce9d1761ee tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.277689 May 13 16:34:17.909908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 623/1342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:17 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:18.927167 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:18.928026 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:18.935958 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:18.948353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:18.948353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:18.948353 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:19.143402 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:19.152668 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-6c332f22-0b68-48eb-8b14-3d7b79b1ab71 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1261 microversion: 2.1 time: 0.229845 May 13 16:34:19.153283 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 720/1343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:18 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:20.169573 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:20.170184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:20.177567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:20.178597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:20.179405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:20.179840 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:20.486478 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:20.497128 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-25618e2f-3cc9-428c-9ed9-2e12c18cec52 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1444 microversion: 2.1 time: 0.331061 May 13 16:34:20.497902 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 624/1344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:20 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1444 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:20.513433 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:34:20.514713 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:34:20.523341 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:20.523789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:20.524577 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:20.525041 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:20.784068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:34:20.793629 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a9ca234f-de01-4e5a-9bd1-ffab877525e0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1444 microversion: 2.1 time: 0.283593 May 13 16:34:20.794983 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 721/1345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:34:20 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1444 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:34:23.887996 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-29beab92-64fa-4dec-91c5-2ba7213b42c4 req-419716c7-1e8f-443c-b642-dac59b4bb124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:34:23.889678 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:34:23.889678 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:34:23.898091 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-29beab92-64fa-4dec-91c5-2ba7213b42c4 req-419716c7-1e8f-443c-b642-dac59b4bb124 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:34:23.898825 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-29beab92-64fa-4dec-91c5-2ba7213b42c4 req-419716c7-1e8f-443c-b642-dac59b4bb124 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:34:23.916050 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-29beab92-64fa-4dec-91c5-2ba7213b42c4 req-419716c7-1e8f-443c-b642-dac59b4bb124 service nova] Creating event network-changed:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:34:23.920939 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-29beab92-64fa-4dec-91c5-2ba7213b42c4 req-419716c7-1e8f-443c-b642-dac59b4bb124 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 May 13 16:34:23.921788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 625/1346] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:34:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:35:13.992831 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1086458155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1568395761", "security_groups": [{"name": "tempest-secgroup-smoke-634050492"}], "block_device_mapping_v2": [{"uuid": "1ee8ab2a-92f9-417d-acf8-2e5cf8762d9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fce931a8-623e-4de8-8c85-53a4453b90f8"}]}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:35:14.151358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.network.neutron [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] validate_networks() for [('fce931a8-623e-4de8-8c85-53a4453b90f8', None, None, None)] {{(pid=93648) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 13 16:35:14.794510 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 13 16:35:14.794965 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image limits 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 13 16:35:14.804290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Flavor pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 13 16:35:14.804290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Image pref 0:0:0 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 13 16:35:14.804290 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.virt.hardware [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 13 16:35:14.804969 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:14.805628 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:14.806499 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:14.806941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:14.824262 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 13 16:35:14.828897 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.quota [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Getting quotas for user 78405c5c40f74675b76fc3b44b6da73b and project 1075a2c9b83e4dc9a1e8d546523c2efe. Resources: {'instances', 'ram', 'cores'} {{(pid=93648) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 13 16:35:14.929995 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Going to run 1 instances... {{(pid=93648) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 13 16:35:14.932109 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ee8ab2a-92f9-417d-acf8-2e5cf8762d9e',volume_size=None,volume_type=None)] {{(pid=93648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 13 16:35:15.401611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-0921e165-026b-4c52-892d-ff9397e48b4b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.412679 May 13 16:35:15.402416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 722/1347] 10.222.0.42 () {60 vars in 1147 bytes} [Thu May 13 16:35:13 2021] POST /compute/v2.1/servers => generated 405 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 16:35:15.413863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bbad56fa-d82b-42f7-9713-8c875d6c20df tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:15.414595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bbad56fa-d82b-42f7-9713-8c875d6c20df tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:15.488428 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bbad56fa-d82b-42f7-9713-8c875d6c20df tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:15.496920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bbad56fa-d82b-42f7-9713-8c875d6c20df tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1095 microversion: 2.1 time: 0.088036 May 13 16:35:15.498105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 626/1348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:15 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:16.514973 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:16.515572 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:16.527056 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:16.527512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:16.528300 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:16.528743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:16.646941 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:16.656376 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f26b9447-710c-441f-bfe4-6bfa8e8f79c4 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1145 microversion: 2.1 time: 0.145799 May 13 16:35:16.656908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 723/1349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:16 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1145 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:17.673504 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:17.674124 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:17.682425 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:17.682885 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:17.683724 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:17.684163 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:17.869626 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:17.880335 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-946a68c2-71f4-4d44-bf90-adfc7ad0fd9a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1201 microversion: 2.1 time: 0.211246 May 13 16:35:17.881060 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 627/1350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:17 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1201 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:18.897886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:18.898576 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:18.906048 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:18.906507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:18.907297 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:18.907751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:19.118905 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:19.128202 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-948df37b-219d-4a2f-8a06-271340b9bbd7 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1278 microversion: 2.1 time: 0.234138 May 13 16:35:19.128989 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 724/1351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:18 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:20.080103 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-6e9021af-dfe5-4538-bdce-d6b594053edb req-1bf57361-d900-4094-bc44-273b97d1be49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9db896-41f5-4b31-acce-096220972729", "tag": "8db87080-70bf-4266-b95c-c99f45400dc7"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:35:20.081633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:35:20.081633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:35:20.090665 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-6e9021af-dfe5-4538-bdce-d6b594053edb req-1bf57361-d900-4094-bc44-273b97d1be49 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:20.091704 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-6e9021af-dfe5-4538-bdce-d6b594053edb req-1bf57361-d900-4094-bc44-273b97d1be49 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:20.109257 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-6e9021af-dfe5-4538-bdce-d6b594053edb req-1bf57361-d900-4094-bc44-273b97d1be49 service nova] Creating event network-changed:8db87080-70bf-4266-b95c-c99f45400dc7 for instance 4b9db896-41f5-4b31-acce-096220972729 on hv-cinder-68948 May 13 16:35:20.114567 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-6e9021af-dfe5-4538-bdce-d6b594053edb req-1bf57361-d900-4094-bc44-273b97d1be49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219329 May 13 16:35:20.115208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 628/1352] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:35:20.145122 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:20.145751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:20.153227 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:20.153681 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:20.154452 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:20.154888 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:20.361269 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:20.372519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7618fe30-9e81-49c2-9812-c9e29d472403 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.230268 May 13 16:35:20.373774 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 725/1353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:20 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:21.392005 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:21.393490 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:21.401820 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:21.402272 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:21.404073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:21.404517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:21.864583 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:21.873248 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-00efbc9c-1c9c-46d4-98f9-5fa1eb4b07f5 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.486036 May 13 16:35:21.873817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 629/1354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:21 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:22.889971 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:22.890598 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:22.898210 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:22.898751 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:22.899611 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:22.900200 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:23.098425 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:23.107259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c807a4a3-856b-4179-9f91-86e859d1ab0f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.220407 May 13 16:35:23.107814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 726/1355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:22 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:24.123778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:24.124422 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:24.131642 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:24.132092 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:24.132866 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:24.133347 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:24.329833 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:24.340364 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bdd46731-6405-4f4d-b658-51f2b0b056dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.220341 May 13 16:35:24.340938 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 630/1356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:24 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:25.356476 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:25.357166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:25.364980 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:25.365469 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:25.366257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:25.366700 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:25.565068 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:25.573430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-048c9522-64d5-4c09-bc09-649c5eb15edd tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.220669 May 13 16:35:25.574054 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 727/1357] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:25 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:26.590113 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:26.590662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:26.598312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:26.598761 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:26.599602 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:26.600160 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:26.798595 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:26.806888 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-ec2ec237-147b-4588-9a33-e1495f0e9f62 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.220508 May 13 16:35:26.807491 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 631/1358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:26 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:27.823743 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:27.824323 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:27.832258 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:27.832709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:27.833519 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:27.833959 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:28.030813 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:28.038935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-29db7ad1-ff3a-42ae-89b8-84a6adf5616f tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.219015 May 13 16:35:28.039498 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 728/1359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:27 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:29.055184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:29.055749 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:29.063229 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:29.063690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:29.064482 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:29.065067 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:29.223744 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-86e14443-fea8-49e7-b687-44ec022296b4 req-abe79d01-075b-4700-9ec0-73c92bbac7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9db896-41f5-4b31-acce-096220972729", "name": "network-vif-plugged", "status": "completed", "tag": "8db87080-70bf-4266-b95c-c99f45400dc7"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:35:29.225566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:35:29.225566 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:35:29.234541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-86e14443-fea8-49e7-b687-44ec022296b4 req-abe79d01-075b-4700-9ec0-73c92bbac7b7 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:29.235166 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-86e14443-fea8-49e7-b687-44ec022296b4 req-abe79d01-075b-4700-9ec0-73c92bbac7b7 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:29.254034 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-86e14443-fea8-49e7-b687-44ec022296b4 req-abe79d01-075b-4700-9ec0-73c92bbac7b7 service nova] Creating event network-vif-plugged:8db87080-70bf-4266-b95c-c99f45400dc7 for instance 4b9db896-41f5-4b31-acce-096220972729 on hv-cinder-68948 May 13 16:35:29.259028 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-86e14443-fea8-49e7-b687-44ec022296b4 req-abe79d01-075b-4700-9ec0-73c92bbac7b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038981 May 13 16:35:29.259626 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 729/1360] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:35:29.270584 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:29.276998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-20461caf-515a-41ab-9d04-22e70d61e39c tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.225692 May 13 16:35:29.277593 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 632/1361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:29 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:30.295059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:30.296282 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:30.303883 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:30.304332 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:30.305119 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:30.305556 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:30.503047 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:30.511312 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-bc3b9940-814c-4024-addf-b713b8b6d6de tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1266 microversion: 2.1 time: 0.220416 May 13 16:35:30.512012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 730/1362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:30 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:31.528178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:31.528954 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:31.536387 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:31.536835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:31.537636 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:31.538077 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:31.834085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:31.842767 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-bf79b920-c753-4cbb-8e8d-371a998754ee tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1453 microversion: 2.1 time: 0.318440 May 13 16:35:31.843341 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 633/1363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:31 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1453 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:31.858967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:35:31.859576 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:35:31.866759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:31.867261 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:31.868032 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:31.868467 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:32.061408 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:35:32.069662 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-c01ccae8-164c-4d7e-8ce2-9f09508c2e1b tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1453 microversion: 2.1 time: 0.214844 May 13 16:35:32.070219 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 731/1364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:35:31 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:35:34.792208 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-4efd148c-e4e6-461a-bea2-3ce29d9e00a3 req-523560dd-63c0-4109-82f2-0da0f07174db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9db896-41f5-4b31-acce-096220972729", "tag": "8db87080-70bf-4266-b95c-c99f45400dc7"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:35:34.793862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:35:34.793862 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:35:34.802715 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4efd148c-e4e6-461a-bea2-3ce29d9e00a3 req-523560dd-63c0-4109-82f2-0da0f07174db service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:35:34.803173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-4efd148c-e4e6-461a-bea2-3ce29d9e00a3 req-523560dd-63c0-4109-82f2-0da0f07174db service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:35:34.819989 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-4efd148c-e4e6-461a-bea2-3ce29d9e00a3 req-523560dd-63c0-4109-82f2-0da0f07174db service nova] Creating event network-changed:8db87080-70bf-4266-b95c-c99f45400dc7 for instance 4b9db896-41f5-4b31-acce-096220972729 on hv-cinder-68948 May 13 16:35:34.825057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-4efd148c-e4e6-461a-bea2-3ce29d9e00a3 req-523560dd-63c0-4109-82f2-0da0f07174db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037160 May 13 16:35:34.825878 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 634/1365] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:35:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:36:20.931916 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:36:20.932651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:20.940406 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:20.940858 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:20.941689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:20.942133 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:21.001753 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lazy-loading 'flavor' on Instance uuid d89b2b63-c067-43c1-8294-2d410954f01a {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:36:21.378156 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e7750c5a-7b6d-4d43-8f0e-0a7c043c1958 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "POST /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a/action" status: 202 len: 0 microversion: 2.1 time: 0.449262 May 13 16:36:21.379203 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 732/1366] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:36:20 2021] POST /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:36:21.389838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f59cf648-e63a-4fd6-9c75-fbd1eeeba03e] AMQP server on 10.222.0.42:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 13 16:36:21.397036 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:21.398410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:21.412964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:21.413809 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:21.415191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:21.415989 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:22.037314 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:22.045913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c15f18df-f9b4-46b8-ac19-cf445e035a39 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.658539 May 13 16:36:22.046503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 635/1367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:21 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:23.065876 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:23.066634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:23.074600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:23.075333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:23.076839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:23.077437 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:23.288913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:23.297771 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-25141d6e-2a58-4bb9-afad-2a69ec35211f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.237308 May 13 16:36:23.298422 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 733/1368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:23 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:36:24.316025 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:24.316732 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:24.336838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:24.337330 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:24.338155 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:24.338594 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:24.395470 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] [f59cf648-e63a-4fd6-9c75-fbd1eeeba03e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56020. May 13 16:36:24.569887 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:24.584599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b71f44ec-bd6f-4add-b5fd-d1ea5d9ba183 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.272123 May 13 16:36:24.585561 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 636/1369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:24 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:25.602619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:25.603244 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:25.611537 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:25.611997 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:25.612802 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:25.613284 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:25.847399 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:25.857198 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dfde9e86-0592-4518-8e17-d3803b79c19a tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.258154 May 13 16:36:25.857772 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 734/1370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:25 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:26.875968 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:26.876690 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:26.885278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:26.885754 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:26.886623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:26.887076 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:27.123476 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:27.133209 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-52e9a1b3-b092-4054-a95c-3f8d1fb36639 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.261128 May 13 16:36:27.133679 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 637/1371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:26 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:28.152305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:28.153381 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:28.162257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:28.162777 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:28.163647 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:28.164153 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:28.378162 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:28.393887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e2a74002-c97e-4bfb-95ef-31a951b4c57d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.245432 May 13 16:36:28.394863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 735/1372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:28 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:36:29.421156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:29.421799 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:29.429405 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:29.430054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:29.430967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:29.431450 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:29.688236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:29.697251 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-5ef29389-906d-4a5e-b9ba-268767ffb3a4 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.279799 May 13 16:36:29.701748 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 638/1373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:29 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:30.716789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:30.717847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:30.726138 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:30.726591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:30.727397 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:30.727844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:30.969129 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:30.983033 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a118492f-c113-40ed-b12b-eb24d1d0a50e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.270622 May 13 16:36:30.984029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 736/1374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:30 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:31.837676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:36:31.837676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:36:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:36:32.001991 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:32.002606 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:32.010778 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:32.011365 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:32.012279 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:32.012812 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:32.230181 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:32.239580 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-8387bf0f-2a39-4ce0-9572-47b6164cf33b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.241987 May 13 16:36:32.240258 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 639/1375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:31 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:33.257097 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:33.257940 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:33.265622 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:33.266098 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:33.266902 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:33.267358 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:33.503344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:33.519189 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cac6fb94-b902-4d1f-89e4-f52ccd53c625 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.265477 May 13 16:36:33.520199 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 737/1376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:33 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:34.542146 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:34.543369 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:34.558663 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:34.559676 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:34.561259 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:34.562073 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:34.802514 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:34.811273 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c5124505-ed5a-42cd-aa07-122a8f613b16 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.276438 May 13 16:36:34.811863 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 640/1377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:34 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:35.829559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:35.830473 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:35.838545 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:35.839029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:35.840131 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:35.840619 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:36.046390 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:36.055416 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f4288c53-f2be-402e-a36d-bba100b25361 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.230675 May 13 16:36:36.056128 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 738/1378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:35 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:37.074942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:37.075832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:37.084479 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:37.085105 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:37.086086 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:37.086642 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:37.541333 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:37.557444 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-58eecd04-680e-4a1e-89ee-ff231b5a2c89 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.486602 May 13 16:36:37.558727 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 641/1379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:37 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:38.583233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:38.583863 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:38.591689 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:38.592186 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:38.592987 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:38.593461 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:38.798935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:38.807608 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-b6a810c8-ce00-4683-a056-dc197327fea0 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.228086 May 13 16:36:38.808191 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 739/1380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:38 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:39.825026 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:39.826191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:39.833832 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:39.834280 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:39.835178 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:39.835613 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:39.860115 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:36:39.862085 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:36:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a (ip 10.222.0.42) !!! May 13 16:36:40.065484 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:40.074553 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-2b149295-4b2b-4ede-b5eb-4f20622b0773 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.253276 May 13 16:36:40.075752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 642/1381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:39 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:36:41.093180 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:41.093806 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:41.101266 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.101719 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:41.102543 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.102975 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:41.315574 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:41.326759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-dabe3fd5-235b-4a7e-a7fd-414a67954dc2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1569 microversion: 2.1 time: 0.237652 May 13 16:36:41.327344 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 740/1382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:41 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:41.345184 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:36:41.346086 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:41.353987 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.354441 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:41.355256 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.355694 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:41.758944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-970fcf39-2054-434d-b3b7-6c5c1fb7992e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "POST /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a/action" status: 202 len: 0 microversion: 2.1 time: 0.419322 May 13 16:36:41.759558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 643/1383] 10.222.0.42 () {60 vars in 1278 bytes} [Thu May 13 16:36:41 2021] POST /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:36:41.768106 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:41.768841 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:41.776448 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.776912 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:41.777747 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:41.778768 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:42.000587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:42.009838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f7b44404-3e39-495e-a200-e86f8df102b5 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1517 microversion: 2.1 time: 0.245832 May 13 16:36:42.010536 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 741/1384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:41 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:43.027351 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:43.027964 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:43.036040 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:43.036486 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:43.037319 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:43.037757 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:43.256324 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:43.265775 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-c6d4369d-fea8-4606-b530-9b6df5474f88 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1517 microversion: 2.1 time: 0.242159 May 13 16:36:43.266348 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 644/1385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:43 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:43.471632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-6f5987f3-3273-4c84-8f09-765c0cef9b0c req-fc02b48f-193f-4a45-a353-6b65061467e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "name": "network-vif-unplugged", "status": "completed", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:36:43.473505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:36:43.473505 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:36:43.482349 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6f5987f3-3273-4c84-8f09-765c0cef9b0c req-fc02b48f-193f-4a45-a353-6b65061467e5 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:43.493839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6f5987f3-3273-4c84-8f09-765c0cef9b0c req-fc02b48f-193f-4a45-a353-6b65061467e5 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:43.500679 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.compute.server_external_events [req-6f5987f3-3273-4c84-8f09-765c0cef9b0c req-fc02b48f-193f-4a45-a353-6b65061467e5 service nova] Unable to find a host for instance d89b2b63-c067-43c1-8294-2d410954f01a. Dropping event network-vif-unplugged {{(pid=93648) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 13 16:36:43.501634 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-6f5987f3-3273-4c84-8f09-765c0cef9b0c req-fc02b48f-193f-4a45-a353-6b65061467e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035662 May 13 16:36:43.502322 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 742/1386] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:36:43 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 13 16:36:44.283766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:44.284373 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:44.291934 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:44.292461 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:44.293350 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:44.293798 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:44.500598 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:44.516662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f2d475b2-a37e-47f9-abec-32d2babb2915 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1519 microversion: 2.1 time: 0.236227 May 13 16:36:44.521963 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 645/1387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:44 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:45.549458 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:45.550970 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:45.560276 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:45.560865 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:45.561967 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:45.562481 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:45.783600 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:45.795459 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-e598f9eb-597b-4fcd-aef9-8ffad1d495af tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1519 microversion: 2.1 time: 0.254653 May 13 16:36:45.796101 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 743/1388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:45 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:46.813994 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:46.814895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:46.823838 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:46.824380 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:46.825381 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:46.825905 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:47.311920 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:47.321895 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-69ad723e-54ab-4806-a77d-21b255800b2b tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.512786 May 13 16:36:47.322742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 646/1389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:46 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:48.341366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:48.342115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:48.349605 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:48.350059 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:48.350859 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:48.351301 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:48.615839 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:48.628908 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-26991a12-6f1a-4e2c-ae50-6cde9cb1b53f tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.292162 May 13 16:36:48.629952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 744/1390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:48 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:49.654362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:49.655013 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:49.662340 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:49.662782 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:49.663564 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:49.663998 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:49.864908 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:49.873410 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-d67689a5-d90c-43b5-8b51-fb1d44c346b6 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.223259 May 13 16:36:49.873983 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 647/1391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:49 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:50.891176 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:50.891913 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:50.900181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:50.900745 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:50.901754 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:50.902246 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:51.117213 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:51.126696 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-44bd11df-8d4f-4d05-bc98-d82df2cada72 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.239528 May 13 16:36:51.127372 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 745/1392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:50 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:52.144412 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:52.145054 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:52.154134 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:52.154631 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:52.155466 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:52.155951 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:52.373448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:52.382421 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4b6d13ac-4413-47c3-8253-c9d5d9200f32 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.241817 May 13 16:36:52.383014 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 648/1393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:52 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:53.399575 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:53.400240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:53.409442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:53.409955 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:53.410895 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:53.411378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:53.678241 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:53.686950 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-97474c89-b4c0-4061-8919-1e07d7233551 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.291224 May 13 16:36:53.687583 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 746/1394] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:53 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:54.707849 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:54.708565 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:54.716887 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:54.717681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:54.718741 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:54.719227 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:54.923606 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:54.932446 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b6422b36-5fb3-469a-860c-b8b408c9498c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.228683 May 13 16:36:54.933309 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 649/1395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:54 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:36:55.951814 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:55.952538 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:55.960305 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:55.960886 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:55.961769 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:55.962257 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:56.273809 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:56.288194 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f6576137-52b6-461e-b5e6-bb4f795ef1da tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.340945 May 13 16:36:56.289012 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 747/1396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:55 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:57.307093 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:57.307860 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:57.316127 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:57.316579 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:57.317494 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:57.317944 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:57.567719 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:57.580742 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-4b5b3224-351c-4809-9c85-8c1662e90122 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.277472 May 13 16:36:57.581683 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 650/1397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:57 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:36:57.754181 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-669cccd9-4308-45b1-ac29-9cafae0686de req-22cdb177-f2b6-4eb7-834e-e240147a7c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "name": "network-vif-plugged", "status": "completed", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:36:57.755673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:36:57.755673 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:36:57.764748 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-669cccd9-4308-45b1-ac29-9cafae0686de req-22cdb177-f2b6-4eb7-834e-e240147a7c81 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:57.765233 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-669cccd9-4308-45b1-ac29-9cafae0686de req-22cdb177-f2b6-4eb7-834e-e240147a7c81 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:57.936445 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-669cccd9-4308-45b1-ac29-9cafae0686de req-22cdb177-f2b6-4eb7-834e-e240147a7c81 service nova] Creating event network-vif-plugged:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:36:57.941803 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-669cccd9-4308-45b1-ac29-9cafae0686de req-22cdb177-f2b6-4eb7-834e-e240147a7c81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191806 May 13 16:36:57.942512 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 748/1398] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:36:58.605336 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:36:58.607039 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:36:58.614985 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:58.615434 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:58.616223 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:36:58.616685 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:36:58.993214 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:36:59.002739 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-13c0f648-8144-49af-b88b-a27506a0f113 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1575 microversion: 2.1 time: 0.401398 May 13 16:36:59.003323 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 651/1399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:36:58 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1575 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:37:00.021851 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:00.022656 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:00.031749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:00.032209 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:00.033036 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:00.033507 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:00.251644 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:00.260645 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-74077c07-bfbb-4070-b7d2-d19b9f4e007e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1562 microversion: 2.1 time: 0.243341 May 13 16:37:00.261259 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 749/1400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:00 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:15.818030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:15.819736 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:15.821079 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-de117abc-e976-4542-88c3-0a0e98f014ce req-22a199f0-ff8d-480e-97ba-d685aa7e4242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9db896-41f5-4b31-acce-096220972729", "tag": "8db87080-70bf-4266-b95c-c99f45400dc7"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:37:15.825847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:37:15.825847 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:37:15.833890 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe3665b-a8b9-47e8-8e37-c134333e66a6] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 13 16:37:15.834788 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:15.835882 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:15.837558 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:15.838915 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:15.845981 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-de117abc-e976-4542-88c3-0a0e98f014ce req-22a199f0-ff8d-480e-97ba-d685aa7e4242 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:15.846595 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-de117abc-e976-4542-88c3-0a0e98f014ce req-22a199f0-ff8d-480e-97ba-d685aa7e4242 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:15.867466 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-de117abc-e976-4542-88c3-0a0e98f014ce req-22a199f0-ff8d-480e-97ba-d685aa7e4242 service nova] Creating event network-changed:8db87080-70bf-4266-b95c-c99f45400dc7 for instance 4b9db896-41f5-4b31-acce-096220972729 on hv-cinder-68948 May 13 16:37:15.874471 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-de117abc-e976-4542-88c3-0a0e98f014ce req-22a199f0-ff8d-480e-97ba-d685aa7e4242 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061368 May 13 16:37:15.875789 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 750/1401] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:37:15.976099 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:37:16.441772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-12418739-59e7-4642-bb61-f1e5c8f8740d tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 204 len: 0 microversion: 2.1 time: 0.630954 May 13 16:37:16.443384 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 652/1402] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:37:15 2021] DELETE /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:37:16.458058 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:16.459310 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:16.474250 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:16.475095 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:16.476522 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:16.477277 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:16.816086 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:16.830232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f4dbcfdc-4b9e-4e7c-9241-e65b9fd008dc tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1578 microversion: 2.1 time: 0.379617 May 13 16:37:16.831430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 751/1403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:16 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1578 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:17.859318 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:17.860182 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:17.867978 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:17.868424 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:17.869249 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:17.869779 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:18.310139 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:18.318603 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-f13d6094-06f1-47b4-8988-703649eabfe2 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1459 microversion: 2.1 time: 0.463879 May 13 16:37:18.319176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 653/1404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:17 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1459 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:19.336591 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:19.340651 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:19.359368 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:19.363692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:19.363692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:19.363692 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:19.398338 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe3665b-a8b9-47e8-8e37-c134333e66a6] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56128. May 13 16:37:19.486726 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:19.499240 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-05da4b8c-b63c-4266-bde1-e715dabf1f23 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1392 microversion: 2.1 time: 0.166667 May 13 16:37:19.500169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 752/1405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:19 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:19.595019 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-52e913e2-c6eb-468d-9b4f-bbba24604b2a req-4cbf87b3-5e2b-42cd-8e4a-2fdc13da1675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9db896-41f5-4b31-acce-096220972729", "name": "network-vif-deleted", "tag": "8db87080-70bf-4266-b95c-c99f45400dc7"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:37:19.596692 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:37:19.596692 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:37:19.605927 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-52e913e2-c6eb-468d-9b4f-bbba24604b2a req-4cbf87b3-5e2b-42cd-8e4a-2fdc13da1675 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:19.606377 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-52e913e2-c6eb-468d-9b4f-bbba24604b2a req-4cbf87b3-5e2b-42cd-8e4a-2fdc13da1675 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:19.623293 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-52e913e2-c6eb-468d-9b4f-bbba24604b2a req-4cbf87b3-5e2b-42cd-8e4a-2fdc13da1675 service nova] Creating event network-vif-deleted:8db87080-70bf-4266-b95c-c99f45400dc7 for instance 4b9db896-41f5-4b31-acce-096220972729 on hv-cinder-68948 May 13 16:37:19.628752 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-52e913e2-c6eb-468d-9b4f-bbba24604b2a req-4cbf87b3-5e2b-42cd-8e4a-2fdc13da1675 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037593 May 13 16:37:19.629488 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 654/1406] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:37:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:37:20.522709 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:20.523946 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:20.541378 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:20.542125 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:20.543491 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:20.544234 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:20.648639 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:20.649115 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:20.649571 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lazy-loading 'fault' on Instance uuid 4b9db896-41f5-4b31-acce-096220972729 {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:37:20.740705 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:20.750376 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-7f39cf55-dc79-469b-b172-84e59742fbba tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 200 len: 1231 microversion: 2.1 time: 0.235410 May 13 16:37:20.750945 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 753/1407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:20 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 1231 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:21.768523 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:21.769413 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 4b9db896-41f5-4b31-acce-096220972729] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:21.778268 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:21.778728 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:21.779570 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:21.780030 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:21.830260 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] HTTP exception thrown: Instance 4b9db896-41f5-4b31-acce-096220972729 could not be found. May 13 16:37:21.830772 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Returning 404 to user: Instance 4b9db896-41f5-4b31-acce-096220972729 could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:37:21.831623 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-105dec17-6bff-46c5-8d93-41cafa654c2a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729" status: 404 len: 111 microversion: 2.1 time: 0.067436 May 13 16:37:21.832195 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 655/1408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:21 2021] GET /compute/v2.1/servers/4b9db896-41f5-4b31-acce-096220972729 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:37:26.503553 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:26.505643 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:26.518008 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:26.518480 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:26.519333 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:26.519791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:26.597840 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Going to try to terminate instance {{(pid=93648) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:37:26.640029 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [req-21ced2ca-b609-42cd-8623-7f9297577a2a req-4b099c27-3d46-40ab-8d62-935e627fbb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f24a0e-ba52-4f95-b700-08d1c0fa342e", "tag": "da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65"}]} {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:37:26.642141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:37:26.642141 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: warnings.warn(msg) May 13 16:37:26.652662 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-21ced2ca-b609-42cd-8623-7f9297577a2a req-4b099c27-3d46-40ab-8d62-935e627fbb0c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:26.653442 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [req-21ced2ca-b609-42cd-8623-7f9297577a2a req-4b099c27-3d46-40ab-8d62-935e627fbb0c service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:26.678517 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.compute.server_external_events [req-21ced2ca-b609-42cd-8623-7f9297577a2a req-4b099c27-3d46-40ab-8d62-935e627fbb0c service nova] Creating event network-changed:da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65 for instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e on hv-cinder-68948 May 13 16:37:26.684628 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [req-21ced2ca-b609-42cd-8623-7f9297577a2a req-4b099c27-3d46-40ab-8d62-935e627fbb0c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177354 May 13 16:37:26.686161 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 656/1409] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:37:27.072044 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-fc728ed6-4b78-4695-8651-a4e8e5de7416 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 204 len: 0 microversion: 2.1 time: 0.574895 May 13 16:37:27.072632 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 754/1410] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:37:26 2021] DELETE /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:37:27.083269 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:27.084465 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:27.094922 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:27.095493 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:27.096437 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:27.097069 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:27.726817 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:27.755681 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b5f3dca8-bf7f-42d9-bf40-da8a3fae5332 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1578 microversion: 2.1 time: 0.676408 May 13 16:37:27.757792 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 657/1411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:27 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1578 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:28.782752 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:28.783640 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:28.791441 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:28.791901 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:28.792845 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:28.793559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:29.060978 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:29.071366 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-4cd805f2-401c-4634-a62b-59ca1ad14adf tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1460 microversion: 2.1 time: 0.293728 May 13 16:37:29.071952 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 755/1412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:28 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1460 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:30.090777 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:30.091768 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:30.099018 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:30.099481 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:30.100287 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:30.100730 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:30.395191 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-6ed44cad-bdfe-492f-900c-7a9b8057981c req-88037bd7-e028-406a-9c12-be8651563df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f24a0e-ba52-4f95-b700-08d1c0fa342e", "name": "network-vif-deleted", "tag": "da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:37:30.399249 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:37:30.399249 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:37:30.414351 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6ed44cad-bdfe-492f-900c-7a9b8057981c req-88037bd7-e028-406a-9c12-be8651563df1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:30.415169 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-6ed44cad-bdfe-492f-900c-7a9b8057981c req-88037bd7-e028-406a-9c12-be8651563df1 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:30.451007 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-6ed44cad-bdfe-492f-900c-7a9b8057981c req-88037bd7-e028-406a-9c12-be8651563df1 service nova] Creating event network-vif-deleted:da7f5fb8-e4cb-495f-a7c6-4656a8eb2c65 for instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e on hv-cinder-68948 May 13 16:37:30.460232 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-6ed44cad-bdfe-492f-900c-7a9b8057981c req-88037bd7-e028-406a-9c12-be8651563df1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070900 May 13 16:37:30.463927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 756/1413] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:37:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:37:30.553398 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:30.566917 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-15d4ec5d-1290-42a5-93a2-fbfd1e2f9956 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1393 microversion: 2.1 time: 0.481185 May 13 16:37:30.567913 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 658/1414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:30 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1393 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:37:31.587601 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:31.588758 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:31.597171 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:31.597633 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:31.598447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:31.598887 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:31.680475 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:31.680935 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:31.681442 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lazy-loading 'fault' on Instance uuid e2f24a0e-ba52-4f95-b700-08d1c0fa342e {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:37:31.744655 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78405c5c40f74675b76fc3b44b6da73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075a2c9b83e4dc9a1e8d546523c2efe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:37:31.753825 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-a4856ae5-0406-4761-9c41-167ed7abaf33 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 200 len: 1231 microversion: 2.1 time: 0.170711 May 13 16:37:31.754430 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 757/1415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:31 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 1231 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:37:32.772325 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:32.773191 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: e2f24a0e-ba52-4f95-b700-08d1c0fa342e] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:32.781245 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:32.781700 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:32.782555 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:32.782990 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:32.835278 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] HTTP exception thrown: Instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e could not be found. May 13 16:37:32.835896 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Returning 404 to user: Instance e2f24a0e-ba52-4f95-b700-08d1c0fa342e could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:37:32.836764 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-0af50d97-7ac3-4f78-9504-cdb4fde33c94 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e" status: 404 len: 111 microversion: 2.1 time: 0.068425 May 13 16:37:32.837382 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 659/1416] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:32 2021] GET /compute/v2.1/servers/e2f24a0e-ba52-4f95-b700-08d1c0fa342e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 16:37:33.806804 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:33.807759 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:33.821383 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:33.822196 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:33.823620 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:33.824418 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:33.933524 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.wsgi [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] HTTP exception thrown: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. May 13 16:37:33.934541 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Returning 404 to user: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. {{(pid=93648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:37:33.935930 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-d08ea4e8-f3d2-4168-bd4f-0f8e90ca7ea8 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 404 len: 111 microversion: 2.1 time: 0.136085 May 13 16:37:33.936811 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 758/1417] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:37:33 2021] DELETE /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:37:33.951320 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:33.952402 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] [instance: 93dcdf08-2e6a-4702-9d0b-668517b4105b] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:37:33.967004 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:33.967818 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:33.969283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:37:33.970095 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:37:34.059283 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] HTTP exception thrown: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. May 13 16:37:34.059967 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Returning 404 to user: Instance 93dcdf08-2e6a-4702-9d0b-668517b4105b could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:37:34.060856 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-b32a53aa-ef60-4eb2-89a3-e05f54f41ce3 tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b" status: 404 len: 111 microversion: 2.1 time: 0.117468 May 13 16:37:34.061500 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 660/1418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:37:33 2021] GET /compute/v2.1/servers/93dcdf08-2e6a-4702-9d0b-668517b4105b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:37:35.859316 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-cf9c00ab-bbfd-4747-81c1-0861d612bc4a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] Calling method '.version_select at 0x7ffa8cc18040>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:37:35.944447 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-cf9c00ab-bbfd-4747-81c1-0861d612bc4a tempest-TestVolumeBootPattern-1708973991 tempest-TestVolumeBootPattern-1708973991-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1568395761" status: 202 len: 0 microversion: 2.1 time: 0.089073 May 13 16:37:35.945029 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 759/1419] 10.222.0.42 () {58 vars in 1263 bytes} [Thu May 13 16:37:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1568395761 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:38:15.882644 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:15.883234 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:15.884570 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-ecc3d4fe-25c6-4bf8-8b96-fc42598f357a req-aea20bae-c648-431d-bd9e-42de7dfe7585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:38:15.886844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:38:15.886844 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:38:15.891503 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:15.892175 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:15.893070 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:15.893597 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:15.896094 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ecc3d4fe-25c6-4bf8-8b96-fc42598f357a req-aea20bae-c648-431d-bd9e-42de7dfe7585 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:15.896791 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-ecc3d4fe-25c6-4bf8-8b96-fc42598f357a req-aea20bae-c648-431d-bd9e-42de7dfe7585 service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:15.914001 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-ecc3d4fe-25c6-4bf8-8b96-fc42598f357a req-aea20bae-c648-431d-bd9e-42de7dfe7585 service nova] Creating event network-changed:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:38:15.919189 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-ecc3d4fe-25c6-4bf8-8b96-fc42598f357a req-aea20bae-c648-431d-bd9e-42de7dfe7585 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038347 May 13 16:38:15.921972 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 760/1420] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 16:38:15.966056 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Going to try to terminate instance {{(pid=93649) delete /opt/stack/nova/nova/compute/api.py:2539}} May 13 16:38:16.323633 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-e5ed77e8-8fa1-4886-919f-12da37bd9d5e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 204 len: 0 microversion: 2.1 time: 0.444103 May 13 16:38:16.325448 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 661/1421] 10.222.0.42 () {58 vars in 1239 bytes} [Thu May 13 16:38:15 2021] DELETE /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 16:38:16.333249 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:16.334228 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:16.342132 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:16.342587 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:16.343395 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:16.343838 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:16.973671 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:38:16.983038 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-5258c924-c44d-49ac-bc61-e46adb9462e2 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1568 microversion: 2.1 time: 0.653780 May 13 16:38:16.983612 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 761/1422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:38:16 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1568 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:38:18.002464 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:18.003173 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:18.011176 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:18.011627 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:18.012401 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:18.012835 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:18.260842 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:38:18.269156 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6ee4b4aa-5d9a-4c35-8400-92b5f3e9d0b9 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1450 microversion: 2.1 time: 0.270904 May 13 16:38:18.269713 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 662/1423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:38:17 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1450 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:38:19.274396 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [req-bb547020-ea7b-4b5c-a292-8c6470b03b8e req-83d51b18-51c1-45a8-b003-98e053c2e3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b2b63-c067-43c1-8294-2d410954f01a", "name": "network-vif-deleted", "tag": "d8158ef5-a243-40af-8957-ba65c001e324"}]} {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 16:38:19.276439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 16:38:19.276439 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: warnings.warn(msg) May 13 16:38:19.284835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-bb547020-ea7b-4b5c-a292-8c6470b03b8e req-83d51b18-51c1-45a8-b003-98e053c2e3db service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:19.286527 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [req-bb547020-ea7b-4b5c-a292-8c6470b03b8e req-83d51b18-51c1-45a8-b003-98e053c2e3db service nova] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:19.286652 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:19.287221 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:19.294918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:19.295744 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:19.296542 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:19.297034 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:19.302022 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.compute.server_external_events [req-bb547020-ea7b-4b5c-a292-8c6470b03b8e req-83d51b18-51c1-45a8-b003-98e053c2e3db service nova] Creating event network-vif-deleted:d8158ef5-a243-40af-8957-ba65c001e324 for instance d89b2b63-c067-43c1-8294-2d410954f01a on hv-cinder-68948 May 13 16:38:19.306835 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [req-bb547020-ea7b-4b5c-a292-8c6470b03b8e req-83d51b18-51c1-45a8-b003-98e053c2e3db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 May 13 16:38:19.311927 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 762/1424] 10.222.0.42 () {64 vars in 1318 bytes} [Thu May 13 16:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 16:38:19.510893 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.policy [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93649) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:38:19.522057 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-eb25ac34-1d50-47ad-a870-72fddc69883e tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1382 microversion: 2.1 time: 0.239341 May 13 16:38:19.522918 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 663/1425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:38:19 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1382 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 16:38:19.528989 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:38:19.529229 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:38:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:38:20.540330 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:20.541150 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.compute.api [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93648) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:20.548794 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:20.549315 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:20.550102 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:20.550559 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:20.620352 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:20.620779 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG oslo_concurrency.lockutils [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:20.621256 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.objects.instance [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lazy-loading 'fault' on Instance uuid d89b2b63-c067-43c1-8294-2d410954f01a {{(pid=93648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 13 16:38:20.677317 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.policy [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73b86e4fe3742109bbeca59c614167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b3dee3fbc494c935bd20a2cda3c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93648) authorize /opt/stack/nova/nova/policy.py:199}} May 13 16:38:20.685749 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-f5817196-295d-45ae-8f88-e32c52acf100 tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 200 len: 1225 microversion: 2.1 time: 0.149599 May 13 16:38:20.686311 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 763/1426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:38:20 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 16:38:21.707657 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '>' {{(pid=93649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:21.708267 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.compute.api [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] [instance: d89b2b63-c067-43c1-8294-2d410954f01a] Fetching instance by UUID {{(pid=93649) get /opt/stack/nova/nova/compute/api.py:2790}} May 13 16:38:21.716207 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:21.716656 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:21.721252 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 13 16:38:21.721252 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG oslo_concurrency.lockutils [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Lock "6c5d0301-3ba9-4c96-ad04-d5ef29ce7cea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 13 16:38:21.765735 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.wsgi [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] HTTP exception thrown: Instance d89b2b63-c067-43c1-8294-2d410954f01a could not be found. May 13 16:38:21.766362 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: DEBUG nova.api.openstack.wsgi [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Returning 404 to user: Instance d89b2b63-c067-43c1-8294-2d410954f01a could not be found. {{(pid=93649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 13 16:38:21.767190 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO nova.api.openstack.requestlog [None req-6e7abf1d-27d1-466a-ac07-b84ace898c0c tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a" status: 404 len: 111 microversion: 2.1 time: 0.063257 May 13 16:38:21.767736 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: [pid: 93649|app: 0|req: 664/1427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu May 13 16:38:21 2021] GET /compute/v2.1/servers/d89b2b63-c067-43c1-8294-2d410954f01a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 16:38:22.194599 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: DEBUG nova.api.openstack.wsgi [None req-17f8b0f5-e8b5-4e3c-baf0-ca1ed718146d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] Calling method '.version_select at 0x7ffa7fff11f0>' {{(pid=93648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 16:38:22.280394 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO nova.api.openstack.requestlog [None req-17f8b0f5-e8b5-4e3c-baf0-ca1ed718146d tempest-TestShelveInstance-181732484 tempest-TestShelveInstance-181732484-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1179113080" status: 202 len: 0 microversion: 2.1 time: 0.089324 May 13 16:38:22.280997 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: [pid: 93648|app: 0|req: 764/1428] 10.222.0.42 () {58 vars in 1254 bytes} [Thu May 13 16:38:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1179113080 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 16:39:51.857703 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:39:51.858353 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:39:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:39:59.915592 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:39:59.916236 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:39:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:41:39.547615 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:41:39.548238 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:41:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:43:11.875958 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:43:11.876599 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:43:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:43:19.933766 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:43:19.934312 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:43:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:43:22.592699 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:43:22.593214 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:43:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:43:38.382254 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:43:38.382942 dv-cinder-689486-12-iscsi devstack@n-api.service[93649]: Thu May 13 16:43:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 16:43:38.688868 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 16:43:38.689406 dv-cinder-689486-12-iscsi devstack@n-api.service[93648]: Thu May 13 16:43:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!